Method and apparatus for conducting an information brokering service

ABSTRACT

A system and method is provided that provides an early indication of consensus of opinion among a number of users regarding an event or observation indicated by a user. Such an opinion may be interesting to an information consumer, who may be interested in determining the outcome of the consensus relating to the event or observation, or may otherwise desire to perform surveillance or survey of a particular issue or subject. Such recognition of early events or observations may be useful in different areas, such as healthcare, finance, etc., where initial observations, if provided early, allow resulting decisions to be made much earlier. The opinion may, for instance, be used as an early indicator of problem with a product, company, etc. that would permit an information consumer to perform an action at a much earlier point than if he/she relied on traditional sources of information. Thus, such opinion information may be invaluable as a tool for monitoring events.

RELATED APPLICATIONS

This application claims priority under 35 U.S.C. §119(e) to U.S.Provisional Application Ser. No. 60/697,213, entitled “SYSTEM, METHODAND APPARATUS FOR ASSEMBLING IDEAS, PREDICTING OUTCOMES, GENERATINGREVENUE, AND PROCESSING DATA IN A SELECTIVE MECHANISM,” filed on Jul. 7,2005, which is herein incorporated by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The field of the invention relates to online information systems, andmore specifically, to online systems having communities of users thatshare ideas.

2. Discussion of the Related Art

The phenomenon of like-minded people going online to share ideas, trade,or compete is well-accepted. In moving from the physical world to thedigital one, users create virtual “communities” where they are boundtogether by the similarities of their interests or activities, ratherthan the proximity of their location. These communities can take anynumber of forms, the most basic being discussion groups, chat rooms,blogs, and forums, which are, in effect, offline communitiesreincarnated online.

Social network theory (SNT) describes how individuals within a communityinteract with one another and the community as a whole. Predictionmarkets (PM) are a newer discipline that have shown that individualscompeting with one another for real or hypothetical rewards collectivelycan make more accurate predictions than organized bodies, who might haveaccess to higher quality information. Additionally, studies have shownthat a modest number of users is sufficient to obtain a high degree ofaccuracy. Various ideas relating to Social Network Theory (SNT) and thePrediction Markets (PM) are disclosed in detail below.

Social Network Theory (SNT)

Social network theory illustrates the ability of persons to influenceone another. What might appear as random conversations between people inthe off-line world, when viewed on-line, can show clear patterns ofinfluence. In practice, people relate to one another in different ways.For example, certain people are more promiscuous in their interactions,speaking with several different people simultaneously, while othersinteract with fewer users, but perhaps more frequently. One of thereasons SNT is studied is that by understanding the mappings connectingan individual to others, one can evaluate the social and or professional“capital” of that individual. In practice, this social capital refers tothe network position of the person and reflects their ability to draw onthe resources available to the members of the network. Human socialnetworks comprise individuals that interact with each other throughfamily, work, recreation, community, social, and other activities.Common to these interactions is the establishment of relationships thatrely on patterns of connection and information exchange processes.

An effective on-line system mimics these interactions. Individuals areable to re-identify each other in the system, as well as identify allthe additional members that the system allows them to come in contactwith. Individuals influence each other directly, through, for example,persuasion, orders, providing information and acting as role models, andthey adjust or modify their behavior in consequence of their interactionwith other individuals, and the environment in which they operate.Communication, and thus social comparison, depends on the individuals.New issues promote discussion and comparison as agreement patternsemerge.

Prediction Markets (PM)

Markets are considered to be a method of allocating resources amongcompeting uses. Markets can also be used when there is an absence of anarbiter with helpful information. Prices ensure that the differentagents competing for access have a common standard for comparison acrossdifferent choices. The market clearing process ensures that eachresource is assigned to its best use. Different market designs satisfydifferent purposes.

Continuous double auction markets provide goods on demand to buyers whoare willing to pay the going rate, while call or options markets improveprices for buyers and sellers when time is not the most crucial factor,allowing for hedging and risk allocation. When a plurality of buyershave needs for different goods, which also are interdependent,combination markets may be necessary.

Prediction markets are a form of market in which the goods being tradedare securities whose values are determined by the outcomes of futureevents. The securities are structured so that trading between buyers andsellers causes the price to reflect the probability of the underlyingevent. When a trader sees a market price (probability) that is less thanher expected probability for the event, she will see a profitopportunity in buying more, thus likely driving the price up. The newprice reflects a higher probability to others monitoring the market.

Prediction markets have been applied to a variety of problems andquestions. Several variations on the basic idea have been described,making it possible to find answers for many different types ofquestions, or apply the concept in a wider set of circumstances. Newvariations of the original prediction market concept suggested ways tosupport conditional bets, which would elicit estimates about therelative chances that alternative approaches would have of achievingcertain outcomes. In these variations, pari-mutuel style betting iscombined with standard double-auction prediction markets to increase theliquidity of the markets at the cost of having prices that don'tdirectly reflect probabilities.

Several automated market makers have proposed different ways to improvethe predictive ability of markets with small numbers of traders (“thinmarkets”). In markets for general commodities, similar approaches canmake thin markets more liquid and make it easier for traders to findcounterparties to trade with. Key, however, is that most markets havebeen limited to questions of broad interest like national elections andthe outcome of professional sporting events. This limitation reflects ashort falling of conventional prediction markets, that their predictivecapability is a direct function of their liquidity, or ultimately theirnumber of active users.

SUMMARY OF THE INVENTION

According to one aspect of the present invention, a system and method isprovided that provides an early indication of consensus of opinion amonga number of users regarding an event or observation indicated by a user.Such an opinion may be interesting to a consumer of information, who maybe interested in determining the outcome of the consensus relating tothe event or observation. Such recognition of early events orobservations may be useful in different areas, such as healthcare,finance, etc., where initial observations, if provided early, allowresulting decisions to be made much earlier. The opinion may, forinstance, be used as an early indicator of problem with a product,company, new insight on a disease, awareness of a disease outbreak, etc.Such an opinion or observation may permit an investor or otherinformation consumer to take a position or take action at a much earlierpoint than if s/he relied on traditional sources of information. Thus,such opinion information may be a valuable tool for monitoring events.

Similarly, such a tool may be also valuable for participants in theadvancement of ideas, especially those that rely on collaborationbetween people (e.g., research) and consensus between observers.However, conventional social networking systems or other onlinecommunities are insufficient for determining what information is likelyto be quality information versus a random or incorrect observation orprediction. That is, it is appreciated that such conventional systemsare incapable of distinguishing quality data from noise.

Also, such networks do not provide proper incentive for experts tocontribute quality information in particular subject areas that would beinteresting to information consumers (e.g., corporations, equitytraders, etc.). Further, prediction markets are insufficient foradvancing original ideas and observations, as predictive events aredefined in such systems by a system operator and users can only vote onthe predictive events set forth by the system operator. Thus, suchsystems may not be used to submit and foster the ideas and observationsoriginated by users.

According to one aspect of the present invention, a distributed systemis provided for determining a consensus of opinion among users.According to one embodiment, the system may be capable of acceptingoriginal observations and opinions submitted by users. The system mayadjudicate and provide incentives for users to make and vote onobservations, opinions and/or predictive events.

Existing predictive markets and social networks are insufficient forsuch an application, for example, as they do not provide properincentives for users to submit quality information and/or provide checksand balances to prohibit users from exploiting the system. To this end,a system is provided that provides incentives and disincentives forusers to cooperatively contribute observations and opinions to an onlinesystem for the purpose of early detection of consensus.

Further, according to another aspect of the present invention, it isappreciated that existing predictive markets and social networks requirea moderator to create issues to be voted on and adjudicate them.However, according to one aspect of the present invention, users arepermitted to define the issues being voted on. Because users create theissues, an online system that permits users to define the issues canfunction as an early warning system, whereby users having an observationcan submit the observation to the system. Such users may be in aposition to make the observation at an earlier point than traditionalmethods of monitoring issues (e.g., waiting for a journal article tocome out on a particular issue, an FDA action in response to an issue,etc.), and thus the early observation may be useful.

According to one aspect of the present invention, a method is providedfor determining consensus of opinion relating to an observation,opinion, and/or a predictive event, used herein interchangeably as setforth by a user. A user may submit an idea to an online system, andother users may submit their opinion of the observation. In oneembodiment, users of the system may be provided incentives to bothcreate their own observations as well as provide their opinions onobservations created by other users. These incentives may be in the formof money paid to users for their observations and opinions ofobservations.

According to one aspect of the present invention, users submitobservations in the form of “tickets” to an online system, the ticketsincluding information relating to the observation or opinion. Thesetickets may be, for instance, holders for an observation or opinion inthe online system. These tickets may be displayed to other users of theonline system, where these other user users may view and cast a “vote”expressing their opinion on the observation.

The system may permit a number of users to vote on the ticket, and,based on the voting performed by users, determine whether there isconsensus forming among the users regarding the observation or opinion.In this manner, the ticket and its associated observation or opinion maybe submitted for feedback to the online system. There, the observationor opinion may be corroborated, refuted, and/or explained by others.

Other users may, for example, corroborate or otherwise agree with anobservation, modify the observation, or disagree with the observation.In one example system, a user may be permitted to “agree” or “disagree”with an observation or opinion. That is, the user may be permitted tosubmit either a positive or negative response.

In another example voting model, a user may be permitted to provideanother response to the observation or opinion in addition to the binaryyes/no, agree/disagree response model. The submitted response may bepresented to other users as an option for response (e.g., in the form ofa multiple choice selection), where other users can select the submittedresponse as their vote on the observation or opinion. In this way, userscan propose new responses relating to the observation or opinion thatcan be voted on by other users.

In another example, users may be permitted to change their vote afterplacing their vote. For instance, it may be beneficial for an earlyvoter to change their response upon receiving information that mightlead the early voter to change their response. For instance, if theearly voter submits a vote that a particular drug prevents cancer, butlater views a journal article including a study that shows that the drugdoes not prevent cancer, then the early voter may be permitted to changetheir vote in response to the additional information. Further, the earlyvoter may be informed by the system of later responses (e.g., in theform of alternative responses provided by later users), which may causethe user to change their response.

Thus, according to one embodiment, the system may facilitate monitoringvoting by later users, and if their voting or other observations (e.g.,in the form of an alternative submitted response) changes the mind ofthe early voter, that voter may be permitted to change their vote. Achange in voting may be permitted during the pendency of a ticket,allowing the consensus result to be a more accurate reflection of theusers' opinions, and allows for earlier voters to change their vote inresponse to later-posted observations. Further, an information consumermay permitted to observe the voting process, and any voting trends thatmay arise during the pendency of the ticket. The system may also providethe information consumer key information relating to the ticket duringthe voting process, such as trends, alternative responses, or otherinformation.

According to one aspect of the present invention, the tickets and theassociated election is created and arbitrated by users rather than asystem operator. That is, users (not an operator) create the issueswhich are decided on by the online user community. In this way, originalobservations usually made by people that are in the best position toreport the observation are submitted to the system. Further, accordingto one embodiment, the system is configured to rapidly disseminate suchobservations to other users. Further, according to another embodiment,it is left to the user community to agree, disagree, or offer analternative response to the observation and otherwise determinecollectively among the user community any consensus of the observation.Also, the voting process may be monitored by the system, and length ofthe voting process may be varied depending on information relating tothe opinions entered by users. Thus, in this way, the users both createand vote on the issues in the online system.

To foster such participation, various mechanisms may be used by thesystem to motivate users. For instance, monetary or any other type ofvalue (e.g., points) may be attributed to tickets, which may increase ordecrease based on the opinions submitted by users. Thus, if other usersagree with an observation, a consensus measurement (referred to hereinas a signal strength) of the ticket is increased. Similarly, if usersdisagree with an observation, the consensus measurement of the ticket isdecreased. Whether other users agree or disagree with the observation, aranking of the user originating the ticket may be affected. Othermechanisms may be used by the system to encourage desired participation(e.g., submitting opinions by particular users in their field ofexpertise, users encouraged to both create observation and expressopinions) and to discourage undesired participation (e.g., gaming of thesystem, submission of non-unique observations, etc.). Further, thesystem may encourage users to submit tickets in particular subject areasto foster ideas in those areas (e.g., by valuing tickets and voting morehighly in such areas). According to one embodiment, the system may userules to provide such incentives and disincentives for user behavior.

According to one aspect of the present invention, an online system maybe provided for users to submit observations, insights, and/orquestions. Such observations, insights, and/or questions may besubmitted in the form of tickets. Information consumers that desire tohave exclusive access to voting results of a particular ticket may bepermitted to bid on the ticket. Once a particular information consumerhas agreed to pay a particular price for the voting results, that ticketis referred to herein as being cultivated.

Users may vote on a ticket until some predetermined criteria is reached.In one embodiment, a consensus determination is performed that indicateswhen the voting process is complete, and the ticket is closed. Consensusmay be measured, for instance, using a parameter (referred to herein assignal strength) that determines whether the voting process is complete.Signal strength may be measured, for example, by the number of usersresponding to a particular ticket, the number of votes cast for aparticular answer, or any combination of information associated with theticket and/or statistic in voting on the ticket. In addition, theinformation consumer may be permitted to specify parameters thatdetermine when signal strength is reached (e.g., when a particularnumber of users vote on the ticket, when a particular number of votesare received, when the ticket should close, etc.). The informationconsumer may be permitted to view voting results in real time, and maybe provided exclusive access to the results after ticket closing. In oneexample, the exclusive access may be granted for a particular period oftime, after which the results may be made available to other users ofthe online system.

Further, according to another aspect, it appreciated that conventionalonline predictive markets may run afoul of online gambling laws,including the United States. In particular, one of several obstaclesfaced by prediction markets is that the gambling laws in severaljurisdictions are written broadly enough so that they can be construedto prohibit use of these markets with real money. Thus, according to oneaspect of the invention, an online information brokering service isprovided that permits users to define and place opinions regardingfuture outcomes, yet not impinge on U.S. gaming laws. In particular,users may be compensated for their opinions regarding predictive eventswithout placing a wager. Rather, they are compensated if their opinionis correct, but not charged if their opinion is incorrect. Othernon-monetary mechanisms (e.g., a ranking) may be used to reflect auser's ability to place correct opinions. Further, information consumersthat purchase the opinion information (e.g., government officials,investors) are not wagering, because, according to one embodiment, thepurchase of opinion information is completed independent of the outcomeof the “ticket/s.” Thus, neither action performed by the user orinformation consumer is a speculative wager.

According to another embodiment of the present invention, a system maybe provided that permits users to associate classification informationwith tickets. For instance, users may be permitted to associateclassification information such as “tags” in order to classify ticketsto permit searching by the system, other users, programs, etc. Further,a computer system associated with the system may process tickets tocreate classifications for a ticket. In one example, the system mayprocess one or more keywords associated with the ticket and classify theticket using those keywords. Further, the computer system may be adaptedto search one or more databases to locate similar keywords with whichthe ticket may be associated. After such classifications are defined,the ticket may be located using such classification.

According to another aspect of the present invention, tickets may beidentified in the system and matched to particular users based on theirclassification information. For instance, a ticket may be classified bya submitting user, along with any classifications assigned by thesystem, and based on the assigned classifications, the submitting useris displayed tickets already submitted to the system having similarclassifications. In this way, the user may more easily locate similartickets. Tickets may be associated with users in other ways, such as,for example, identifying tickets to users that voted on similar tickets,identifying tickets to users who are identified as experts in aparticular area, identifying tickets to particular consumers of ticketinformation that may have previously bid on such information, amongothers.

According to one aspect of the present invention, a method is providedfor conducting an online information brokering service. The methodcomprises acts of permitting a creation of a ticket by at least oneuser, the ticket comprising at least one observation generated by auser, presenting, by a computer system, the ticket to at least one otheruser, and accepting, from the at least one other user, an opinion of theat least one other user regarding the at least one ticket. According toone embodiment of the invention, the method further comprises an act ofpresenting, to the at least one user, an interface that permits the atleast one user to selectively create the ticket. According to anotherembodiment, the method further comprises an act of presenting, to the atleast one other user, an interface that permits the at least one otheruser to submit an opinion relating to the created ticket. According toanother embodiment, the method further comprises an act of providing forthe at least one other user to submit a vote with respect to theobservation. According to another embodiment, the method furthercomprises an act of providing for the at least one other user to submitan alternative opinion with respect to the observation.

According to one embodiment of the invention, the computer systemaccepts a plurality of user opinions relating to the created ticket.According to another embodiment, a length of time by which the computersystem accepts the plurality of user opinions is determined based on adetermination of consensus among the plurality of user opinions.According to another embodiment, the length of time is determinedwithout intervention by an operator of the online information brokeringservice.

According to another embodiment, the method further comprises an act ofdetermining a value of the ticket. According to another embodiment, theact of determining the value of the ticket comprises an act ofdetermining the value by a bid process. According to another embodiment,the bid process includes an act of permitting at least one informationconsumer to bid on the ticket. According to another embodiment, the actof determining the value of the ticket further comprises an act ofclassifying the observation in a predetermined class, the predeterminedclass having a predetermined value, and determining the value of theticket based on the predetermined value of the predetermined class.

According to one embodiment of the invention, the method furthercomprises an act of providing an incentive, by an operator of the onlineinformation brokering system, to users to submit tickets relating to aparticular predetermined class. According to another embodiment, themethod further comprises an act of permitting the at least one user tosend the created ticket to the at least one other user. According toanother embodiment, the method further comprises an act of sending thecreated ticket to a group of users to which the at least one user has arelationship. According to another embodiment, the act of determining avalue of the ticket further comprises an act of valuing the ticket at ahigher value than a later-created ticket that relates to a similarsubject as the ticket. According to another embodiment, the methodfurther comprises acts of permitting a user to create a proposed ticketand determining whether the proposed ticket is similar to the createdticket.

According to one embodiment of the invention, the method furthercomprises an act of presenting to the user, the created ticket if theproposed ticket is similar to the created ticket. According to anotherembodiment, the method further comprises an act of rewarding the atleast one other user based on the opinion of the at least one other userregarding the at least one ticket. According to another embodiment, themethod further comprises an act of determining a reward based on aranking of the at least one other user.

According to another embodiment, the method further comprises an act ofdetermining the ranking of the at least one other user. According toanother embodiment, the act of determining the ranking of the at leastone other user further comprises an act of determining the ranking basedon a history of voting of the at least one other user. According toanother embodiment, the act of determining the ranking of the at leastone other user further comprises an act of determining the ranking basedon an ability of the at least one other user to vote for a correctoutcome of the ticket. According to another embodiment, the act ofdetermining the ranking of the at least one other user further comprisesan act of reducing the ranking if the at least one other user places avote for an incorrect outcome of the ticket.

According to one embodiment of the invention, the act of determining theranking of the at least one other user further comprises an act ofdetermining the ranking of the at least one other user based on a ratioof a number of agreeing votes and a number of disagreeing votes receivedafter the opinion of the at least one other user has been made.According to another embodiment, the act of determining the ranking ofthe at least one other user further comprises an act of rewarding anearlier vote more highly than a later vote on a same ticket. Accordingto another embodiment, the act of determining the ranking of the atleast one other user further comprises an act of determining user incomebased on at least one of a group comprising a ranking of the user, anumber of votes in agreement with the defined ticket, a weight of thedefined ticket, a number of outstanding tickets, and a consensus qualityparameter associated with the defined ticket. According to anotherembodiment, the method further comprises an act of conducting a bidprocess to determine a sale of opinion information associated with theticket to a winning bidder. According to one embodiment, the methodfurther comprises an act of displaying, to the winning bidder, theopinion information in a display of a computer system.

According to one embodiment of the invention, the act of determining thevalue of the ticket includes an act of conducting a voting process amonga plurality of users, wherein a result of the voting process in used inthe act of determining the value of the ticket. According to anotherembodiment, the act of determining the value of the ticket includes anact of determining a market value of opinion information related to theticket. According to another embodiment, the method further comprises anact of determining a ranking of the at least one user. According toanother embodiment, the act of determining the ranking of the at leastone user further comprises an act of determining the ranking based on ahistory of voting of the at least one user. According to anotherembodiment, the act of determining the ranking of the at least one userfurther comprises an act of determining the ranking based on an abilityof the at least one user to vote for a correct outcome of at least oneticket. According to another embodiment, the act of determining theranking of the at least one user further comprises an act of reducingthe ranking if the at least one user places a vote for an incorrectoutcome of the at least one ticket.

According to one embodiment of the invention, the act of determining theranking of the at least one user further comprises an act of determiningthe ranking of the at least one user based on a ratio of a number ofagreeing votes and a number of disagreeing votes received after theopinion of the at least one user has been made. According to anotherembodiment, the act of determining the ranking of the at least one userfurther comprises an act of determining a weighting associated with theat least one user. According to another embodiment, the act ofdetermining the weighting associated with the at least one user furthercomprises an act of weighting a value of the created ticket by thedetermined weighting. According to another embodiment, the act ofdetermining the weighting associated with the at least one user furthercomprises an act of multiplying the value of the created ticket by thedetermined weighting to determine a weighted value of the ticket.According to another embodiment, the act of determining the weightingassociated with the at least one user further comprises an act ofdetermining an independent weighting depending on a classification ofthe ticket. According to another embodiment, the act of determining theweighting associated with the at least one user further comprises an actof maintaining a plurality of independent weightings for the at leastone user, each independent weighting being associated with a particularclassification.

According to one embodiment of the invention, the method furthercomprises an act of determining a reward to the at least one userincluding an act of reducing the value of the ticket by an amount paidto the at least one other user, the at least one other user having votedon the ticket. According to another embodiment, the method furthercomprises an act of determining a consensus of opinion among a pluralityof users regarding the at least one observation of the ticket. Accordingto another embodiment, the method further comprises an act of measuringat least one parameter associated with the ticket. According to anotherembodiment, the act of determining a consensus of opinion furthercomprises an act of determining the consensus of opinion based on the atleast one measured parameter. According to another embodiment, the atleast one measured parameter comprises a number of votes on the ticketreceived from users. According to another embodiment, the act ofdetermining a consensus of opinion further comprises an act ofdetermining a quality of the consensus of opinion. According to anotherembodiment, the act determining a quality of the consensus of opinioncomprises an act of maintaining a quality parameter that indicates thequality of the consensus of opinion.

According to one embodiment of the invention, the method furthercomprises an act of increasing the quality parameter if it is determinedthat a plurality of users having a similar background have a similaropinion regarding the at least one observation of the ticket. Accordingto another embodiment, the method further comprises an act of permittingthe at least one user to send the created ticket to the at least oneother user. According to another embodiment, the method furthercomprises an act of sending the created ticket to a group of users towhich the at least one user previously sent a previously-created ticket.According to another embodiment, the method further comprises an act ofending a voting period of the ticket in response to the act ofdetermining the consensus of opinion among the plurality of users.According to another embodiment, the method further comprises an act ofdisplaying, to a consumer of the ticket, consensus informationindicating the consensus of opinion among the plurality of users.According to another embodiment, the act of displaying is responsive tothe act of ending a voting period of the ticket. According to anotherembodiment, the act of determining a consensus of opinion among aplurality of users regarding the at least one observation of the ticketis determined as a function of a number of votes received on the ticket.

According to one embodiment of the invention, the method furthercomprises an act of determining collusion between a plurality of users.According to another embodiment, the method further comprises an act ofdetermining a repeated pattern of voting among the plurality of users.According to another embodiment, the act of determining a repeatedpattern of voting among the plurality of users further comprises adetermination of a distribution of voting among the plurality of users.According to another embodiment, the method further comprises an act ofcomparing the determined distribution of voting with a distribution ofusers. According to another embodiment, the distribution of user isorganized by at least one of the group comprising location andorganization.

According to another aspect of the present invention, a method isprovided for conducting an online information brokering service. Themethod comprises acts of permitting a creation of a ticket by at leastone user, the ticket comprising at least one observation generated by auser, presenting, by a computer system, the ticket to a plurality ofusers, accepting, from each of the plurality of users, a respectiveopinion regarding the ticket; and determining a consensus of opinionamong a plurality of users regarding the at least one observation of theticket. According to one embodiment of the invention, the computersystem accepts a plurality of user opinions relating to the createdticket. According to another embodiment, a length of time by which thecomputer system accepts the plurality of user opinions is determinedbased on a determination of consensus among the plurality of useropinions. According to another embodiment, the method further comprisesan act of measuring at least one parameter associated with the ticket.According to another embodiment, the act of determining a consensus ofopinion further comprises an act of determining the consensus of opinionbased on the at least one measured parameter. According to anotherembodiment, the at least one measured parameter comprises a number ofvotes on the ticket received from users. According to anotherembodiment, the act of determining a consensus of opinion furthercomprises an act of determining a quality of the consensus of opinion.

According to one embodiment of the invention, the act determining aquality of the consensus of opinion comprises an act of maintaining aquality parameter that indicates the quality of the consensus ofopinion. According to another embodiment, the method further comprisesan act of increasing the quality parameter if it is determined that aplurality of users having a similar background have a similar opinionregarding the at least one observation of the ticket. According toanother embodiment, the method further comprises an act of determiningthe ranking of the at least one of the plurality of users. According toanother embodiment, the method further comprises an act of permittingthe at least one user to send the created ticket to the at least one ofthe plurality of users. According to another embodiment, the methodfurther comprises an act of sending the created ticket to a group ofusers to which the at least one user previously sent apreviously-created ticket. According to another embodiment, the methodfurther comprises an act of sending the created ticket to a group ofusers, wherein the group of users includes a group of users identifiedas experts in a particular subject area. According to anotherembodiment, the method further comprises an act of determining a rewardto the at least one of the plurality of users in response to the atleast one of the plurality of users's opinion, the reward being based ona ranking of the at least one of the plurality of users. According toanother embodiment, the method further comprises an act of determiningthe ranking of the at least one of the plurality of users.

According to one embodiment of the invention, the act of determining theranking of the at least one of the plurality of users further comprisesan act of determining the ranking based on a history of voting of the atleast one of the plurality of users. According to another embodiment,the act of determining the ranking of the at least one of the pluralityof users further comprises an act of determining the ranking based on anability of the at least one of the plurality of users to vote for acorrect outcome of the ticket. According to another embodiment, the actof determining the ranking of the at least one of the plurality of usersfurther comprises an act of reducing the ranking if the at least one ofthe plurality of users places a vote for an incorrect outcome of theticket. According to another embodiment, the act of determining theranking of the at least one of the plurality of users further comprisesan act of determining the ranking of the at least one of the pluralityof users based on a ratio of a number of agreeing votes and a number ofdisagreeing votes received after the opinion of the at least one of theplurality of users has been made. According to another embodiment, theact of determining the ranking of the at least one of the plurality ofusers further comprises an act of rewarding an earlier vote more highlythan a later vote on a same ticket.

According to one embodiment of the invention, the act of determining theranking of the at least one of the plurality of users further comprisesan act of determining user income based on at least one of a groupcomprising a ranking of the at least one user, a number of votes inagreement with the defined ticket, a weight of the defined ticket, anumber of outstanding tickets, and a consensus quality parameterassociated with the defined ticket. According to another embodiment, themethod further comprises an act of ending a voting period of the ticketin response to the act of determining the consensus of opinion among theplurality of users. According to another embodiment, the method furthercomprises an act of displaying, to a consumer of the ticket, consensusinformation indicating the consensus of opinion among the plurality ofusers. According to another embodiment, the act of displaying isresponsive to the act of ending a voting period of the ticket. Accordingto another embodiment, the act of determining a consensus of opinionamong a plurality of users regarding the at least one observation of theticket is determined as a function of a number of votes received on theticket. According to another embodiment, the method further comprises anact of determining a value of the ticket. According to anotherembodiment, the act of determining the value of the ticket comprises anact of determining the value by a bid process.

According to one embodiment of the invention, the bid process includesan act of permitting at least one information consumer to bid on theticket. According to another embodiment, the act of determining thevalue of the ticket further comprises an act of classifying theobservation in a predetermined class, the predetermined class having apredetermined value, and determining the value of the ticket based onthe predetermined value of the predetermined class. According to anotherembodiment, the method further comprises an act of providing anincentive, by an operator of the online information brokering system, tousers to submit tickets relating to a particular predetermined class.According to another embodiment, the method further comprises an act ofconducting a bid process to determine a sale of opinion informationassociated with the ticket to a winning bidder. According to anotherembodiment, the method further comprises an act of displaying, to thewinning bidder, the opinion information in a display of a computersystem. According to another embodiment, the act of determining thevalue of the ticket includes an act of conducting a voting process amonga plurality of users, wherein a result of the voting process in used inthe act of determining the value of the ticket.

According to one embodiment of the invention, the act of determining thevalue of the ticket includes an act of determining a market value ofopinion information related to the ticket. According to anotherembodiment, the method further comprises an act of determining a rankingof the at least one user. According to another embodiment, the methodfurther comprises determining a value of the ticket based on the rankingof the at least one user. According to another embodiment, the ticket iscreated without intervention by an operator of the online informationbrokering service. According to another embodiment, the method furthercomprises an act of determining a quality of the observation of theticket. According to another embodiment, the quality of the observationof the ticket is determined without intervention by an operator of theonline information brokering service. According to another embodiment,the consensus of opinion is determined without intervention by anoperator of the online information brokering service. According toanother embodiment, the consensus of opinion is determined by voting bythe plurality of users.

According to another aspect of the present invention, a method isprovided for conducting an online information brokering service. Themethod comprises permitting a creation of a ticket by at least one user,the ticket comprising at least one observation generated by the at leastone user, and accepting, from a plurality of users, a plurality ofrespective opinions regarding the ticket. According to one embodiment ofthe invention, the method further comprises an act of determining a rankof the at least one user. According to another embodiment, the methodfurther comprises an act of determining a rank of each of the pluralityof users.

According to another embodiment, the method further comprises an act ofadjusting the rank of the at least one user based on the plurality ofrespective opinions regarding the ticket. According to anotherembodiment, the method further comprises an act of adjusting the rank ofeach of the respective users based on their ability to predict anoutcome of the plurality of respective opinions regarding the ticket.According to another embodiment, the method further comprises an act ofincreasing the rank of the at least one user if the plurality ofrespective opinions regarding the ticket form a consensus of agreementwith the observation of the ticket. According to another embodiment, themethod further comprises an act of decreasing the rank of the at leastone user if the plurality of respective opinions regarding the ticket donot form a consensus of agreement with the observation of the ticket.According to another embodiment, the method further comprises an act ofdecreasing the rank of the at least one user if the plurality ofrespective opinions regarding the ticket form a consensus ofdisagreement with the observation of the ticket.

According to one embodiment of the invention, the method furthercomprises an act of increasing the rank of at least one of the pluralityof users if the at least one user correctly predicts the outcome of theplurality of respective opinions regarding the ticket. According toanother embodiment, the method further comprises an act of decreasingthe rank of at least one of the plurality of users if the at least oneuser incorrectly predicts the outcome of the plurality of respectiveopinions regarding the ticket. According to another embodiment, themethod further comprises an act of determining a consensus of opinionamong a plurality of users regarding the at least one observation of theticket. According to another embodiment, the method further comprisesacts of maintaining a plurality of tickets created by a plurality ofusers.

According to another embodiment, the method further comprises an act oflimiting, for at least one user of the plurality of users, a number ofopinions relating to the plurality of tickets that the at least one userof the plurality of users can enter. According to another embodiment,the method further comprises an act of linking, for the at least oneuser of the plurality of users, the number of opinions the at least oneuser of the plurality of users can enter to a number of tickets createdby at least one user of the plurality of users. According to anotherembodiment, the method further comprises an act of limiting a number oftickets that can be created by the at least one user. According toanother embodiment, the method further comprises an act of limiting anumber of tickets that are outstanding from the at least one user.According to another embodiment, the method further comprises an act ofproviding an incentive to the at least one user if the ticket relates toan area of expertise of the at least one user.

According to one embodiment of the invention, the method furthercomprise an act of rewarding an earlier vote more highly than a latervote on a same ticket. According to another embodiment, the methodfurther comprises acts of permitting a user to create a proposed ticketand determining whether the proposed ticket is similar to the createdticket. According to another embodiment, the method further comprises anact of presenting to the user, the created ticket if the proposed ticketis similar to the created ticket.

According to another aspect of the present invention, a method isprovided for conducting an online information brokering service. Themethod comprises acts of permitting at least one user to define aprediction of an event, and accepting, from at least one other user, anopinion regarding the defined prediction, and compensating the at leastone other user if the opinion is correct. According to one embodiment ofthe invention, the at least one user does not place a wager to qualifyfor being compensated. According to another embodiment, the predictionof the event is defined by the at least one user without intervention ofan operator of the online information brokering service. According toanother embodiment, the method further comprises an act of paying, by ainformation consumer, for opinion information relating to the predictionof the event. According to another embodiment, the act of paying doesnot depend on whether the prediction of the event is correct. Accordingto another embodiment, the act of paying is independent of the outcomeof the event. According to another embodiment, the method furthercomprises an act of determining a value of the opinion information.According to another embodiment, the method further comprises an act ofconducting a bid process among a plurality of information consumers, andwherein a result of the bid process determines the value of the opinioninformation. According to another embodiment, the method furthercomprises an act of compensating the at least one user if the opinion iscorrect.

According to another aspect of the present invention, a method isprovided for conducting an online information service. The methodcomprises acts of collecting opinion information from a plurality ofusers, the opinion information relating to an event defined by at leastone user, and providing the opinion information to at least oneinformation consumer. According to one embodiment of the invention, themethod further comprises an act of defining a trigger by the at leastone information consumer, the trigger being activated by at least oneparameter associated with the event defined by the at least one user.According to another embodiment, the method further comprises an act ofactivating the trigger upon the creation of an event including the atleast one parameter. According to another embodiment, the event relatesto a product, and wherein the trigger, when activated, provides anindication to the at least one information consumer. According toanother embodiment, the method further comprises providing an indicationto the at least one information consumer that the trigger was activated.According to another embodiment, the method further comprises acts ofcompensating the plurality of users for the opinion information andselling the opinion information to the at least one informationconsumer. According to another embodiment, the method further comprisesan act of conducting a bid process to determine the at least oneinformation consumer to which the opinion information is sold. Accordingto another embodiment, the method further comprises an act ofdetermining a consensus of the collected opinion information. Accordingto another embodiment, the act of providing the opinion information toat least one information consumer is responsive to the act ofdetermining a consensus of the collected opinion information. Accordingto another embodiment, the plurality of users include informationproviders that are identified experts in a subject field to which theopinion information relates. According to another embodiment, the methodfurther comprises an act of maintaining a profile of at least one of theplurality of users.

According to one embodiment of the invention, the method furthercomprises an act of sending the event defined by at least one user to atleast one user based on the maintained profile. According to anotherembodiment, the method further comprises an act of targeting the atleast one user to receive the event, wherein the act of targeting isperformed responsive to a parameter associated with the maintainedprofile. According to another embodiment, the parameter measures anability of the at least one user to predict event outcomes. According toanother embodiment, the parameter measures an ability of the at leastone user to recognize trends in opinions. According to anotherembodiment, the parameter measures an ability of the at least one userto influence opinions of other users. According to another embodiment,the method further comprises an act of permitting at least one of theplurality of users to change their opinion.

According to another aspect of the present invention, a method isprovided for conducting an online information brokering service. Themethod comprises acts of permitting a creation of a ticket by at leastone user, the ticket comprising at least one observation generated by auser, classifying the ticket by associating one or more tags to theticket, and locating the ticket based upon the one or more tags.According to one embodiment of the invention, the method furthercomprises an act of determining, by a computer system, one or moresuggested tags for classifying the ticket, and displaying to the user asthe ticket is being created the one or more suggested tags. According toanother embodiment, the method further comprises determining, based on adescription associated with the ticket, the one or more suggested tags.

According to another embodiment, the method further comprises an act ofdisplaying to the user in real-time, the one or more suggested tags asthe description associated with the ticket is created by the user.According to another embodiment, the method further comprises an act ofpermitting the user to associate the one or more tags with the ticket.According to another embodiment, the method further comprises an act ofpermitting the user to accept at least one of the one or more suggestedtags. According to another embodiment, the method further comprises anact of searching one or more databases to determine whether a similarticket exists, the act of searching being based at least in part on theone or more tags.

According to one embodiment of the present invention, the method furthercomprises an act of determining, based on the search, whether the ticketis unique among a plurality of previously-created tickets. According toanother embodiment, the method further comprises an act of determiningone or more related tags associated with the one or more tags, andpresenting the one or more related tags to the user. According toanother embodiment, the method further comprises acts of presenting, bya computer system, the ticket to a plurality of users, accepting, fromeach of the plurality of users, a respective opinion regarding theticket, and determining a consensus of opinion among a plurality ofusers regarding the at least one observation of the ticket. According toanother embodiment, the computer system accepts a plurality of useropinions relating to the created ticket.

According to another embodiment, the method further comprises an act ofpresenting one or more similar tickets to the user. According to anotherembodiment, the method further comprises an act of presenting one ormore users that authored the one or more similar tickets to the user.According to another embodiment, the method further comprises an act ofdisplaying, to the user, an indication of the number of ticketsassociated with a particular tag. According to another embodiment, themethod further comprises an act of permitting the user to locate similartickets relating to the displayed number of tickets.

Further features and advantages of the present invention as well as thestructure and operation of various embodiments of the present inventionare described in detail below with reference to the accompanyingdrawings. In the drawings, like reference numerals indicate like orfunctionally similar elements.

BRIEF DESCRIPTION OF DRAWINGS

The accompanying drawings are not intended to be drawn to scale. In thedrawings, each identical or nearly identical component that isillustrated in various figures is represented by a like numeral. Forpurposes of clarity, not every component may be labeled in everydrawing. In the drawings:

FIG. 1 is a chart showing a number of knowledgeable people as a functionof time accordance with aspects of the present invention;

FIG. 2 is a flow chart showing a process for interacting with an onlinesystem according to one embodiment of the present invention;

FIG. 3 is a flow chart showing a process for interacting with an onlinesystem according to another embodiment of the present invention;

FIG. 4 is an example use case showing a process for conducting an onlinesystem according to one embodiment of the present invention;

FIG. 5 is an example use case showing a process for conducting an onlinesystem according to another embodiment of the present invention;

FIG. 6 is an example use case showing a process for conducting an onlinesystem according to another embodiment of the present invention;

FIG. 7 is a block diagram of a general-purpose computer system uponwhich various embodiments of the invention may be implemented;

FIG. 8 is a block diagram of a computer system with which variousembodiments of the invention may be practiced;

FIG. 9A is a block diagram showing an example creation of a ticket andtagging process according to one embodiment of the present invention;

FIG. 9B is a block diagram showing example database elements accordingto one embodiment of the present invention that may be used in a ticketaccess and triggering process;

FIG. 10 is a flow chart showing an overall logic flow of ticket creationand lifetime in an online system according to one embodiment of thepresent invention;

FIG. 11 is a flow chart showing a thematic logic flow of ticket creationand lifetime in an application to the healthcare industry according toone embodiment of the present invention;

FIG. 12 is a flow chart showing another example logic flow of ticketcreation and lifetime according to one embodiment of the presentinvention;

FIGS. 13A and 13B (collectively, FIG. 13) include a flow chart showinganother example logic flow of ticket creation and lifetime according toanother embodiment of the present invention;

FIG. 14 is a diagram showing an example interface of an online systemaccording to one embodiment of the present invention; and

FIG. 15 is a diagram showing an example interface of an online systemaccording to one embodiment of the present invention.

DETAILED DESCRIPTION

According to one aspect of the present invention, it is appreciated thatit may be useful to convey information from early observers toinformation consumers so that decisions can be made at an early stage.One aspect of the present invention relates to an early detection andsurvey method to track and predict trends in various markets which canbe used to monetize the early trends.

As shown in FIG. 1, it is appreciated that it takes time for informationto be disseminated from people that have early observations (e.g., aphysician that makes a useful observation in the field) to other peopleand entities that act on such information (e.g., an information consumersuch as the FDA). For instance, a period of days, weeks, or even monthsmay elapse before a useful observation becomes public knowledge (e.g.,through a newswire service) and becomes public information. There may beadditional periods of time that elapse before the observation makes itsway to others interested in such information (e.g., to form opinions orto perform an action based on such information). According to oneaspect, it is appreciated that an early observation, if corroborated,may be effectively used as information to perform an action. One exampleincludes detection and reporting of adverse effects of drugs. Aninformation consumer such as the FDA, an investor, or other entity mayperform an action (e.g., open an inquiry, perform a trade) in responseto receiving the adverse information generated by an early observer inthe field. If received early, such information may be used to savelives, time, and money.

To this end, it is appreciated that a system and method for identifyingearly observations and communicating them amongst interested parties ina more timely manner would be beneficial. In one embodiment, one or morecomputer systems (e.g., Personal Computers (PCs), Portable DigitalAssistants (PDAs), telephones, or other computer system types) usingvarious forms of communication (e.g., Internet, cellular network, etc.)may be used to create an online ecosystem described below used toexchange observation information between information providers andconsumers, and to corroborate such observations.

Online Ecosystem

In one embodiment, an online “ecosystem” is created, the ecosystemincluding a community of users that together, function to exchangeinformation. Such an ecosystem may be novel in its integration ofprediction markets, social networking, decision making, and groupconsensus. In such an ecosystem, a community is created by one or morerules influencing the behavior of a plurality of users. According to oneembodiment, the rules adhere to the basic drives and ambitions of theusers and channel the interested users back into the ecosystemcommunity. In particular, rules may be designed that provide incentives(and disincentives) for certain types of behavior. Optimally, the rulesencourage users to submit original ideas and encourage others to reviewthese ideas to foster consensus. In one embodiment, the rules functionwithout external (other than users) or moderator intervention.

The overall ecosystem may be driven by several processes. One processpermits users to take independent actions, and the user's independentactions affect the ecosystem. Therefore, the ecosystem can beself-perpetuating. Further, the ecosystem can create its own content, asusers define and vote on the observations and opinions of others. Theecosystem may be self-regulating, for instance, as users determine thevalue of the collected observations and opinions. One method of thedriving of the ecosystem involves recruiting new users as individualswithin the ecosystem pursue their own interests.

The ecosystem can be manipulated to fit the interests of those that runthe ecosystem (e.g., a system operator) is by generating valuable datafor third parties that consume information generated by the ecosystem.One method for ensuring that valuable data is generated includescreating rules that promote the creation of valuable data, and byintegrating adjustable variables into the rules.

Such an ecosystem may be applied to different problems, markets, andsubject areas. One such application is healthcare, and the medicine ingeneral. The healthcare industry is a good application of such a system,as there are a number of readily available customers for the informationgenerated by the ecosystem. For instance, there is a need to captureoriginal observations to further the advancement of understanding ofmedical treatment, drugs, and related research, and to ensure patientsafety. Such observations may also be valuable to the financialcommunity when making investment decisions, and thus a system that makessuch observations aware to the community would be beneficial. Anotherapplication includes the observation of the spread of disease, andmonitoring for outbreaks of such diseases. Further, the ecosystem maypermit physicians to further the advancement ideas by allowing them tosubmit observations and to comment on observations of their physiciancolleagues.

The ecosystem may align the interests of clinicians, industry, andresearchers to more effectively capture physician observations andinsight, potentially improving surveillance and allowing more rapidinsight into physician consensus on a given topic. Organizations thatbenefit from early insight into healthcare information create afinancial incentive used to generate, sustain, and regulateparticipation in the online community or ecosystem.

One version of the ecosystem can leverage a high value ofhealthcare-related subject-specific information that can be shared amonginterested users. Further, the ecosystem can successfully exploitmultiple behaviors of various users, such as greed, drive forcollaboration, and humanitarianism. Because there is a continuous needfor information, the information of the ecosystem is self-renewing andreplenishes itself continuously. Although healthcare is one applicationof such an ecosystem, it should be appreciated that the invention is notlimited to any specific field, and may be applied to otherinformation-sharing situations where collaboration facilitatesinformation that has value.

In one example application of such a system, a value of a physician'sobservation (modeled in the system in the form of a “ticket”) in thesystem is determined by how many people agree or disagree with theobservation at any given moment. Physicians from diverse backgrounds areincentivized to submit observations and to corroborate or dispute thoseobservations to the system, providing a resultant method by whichclinical data may be gathered. Further, a ranking of users may bedetermined, used to determine a value of observations, and toincentivize desired ticket creation and/or voting behavior.

Example Ecosystem

In one example implementation, a system is provided that permits a userto perform a number of actions relating to observations or opinionssubmitted by users. In one particular embodiment, the user may submitobservations or vote on existing observations. In one exampleimplementation, the observation may be represented in the system in theform of a “ticket.” In the example, the ticket is a construct thatpermits an idea to be shared and viewed by other users as well asallowing the system to track the idea as it progresses through theecosystem.

A user may create an observation by creating a ticket that describes theobservation. In one example, the ticket includes a number of parametersincluding a description of the observation as entered by a user (e.g.,in the form of text and/or phrases describing the observation). In oneexample, the length of description of the observation associated withthe ticket may be any length (e.g., no minimum or maximum length). Inother words, the observation description can be as long as a user wants,or as short as he/she wants.

Also, the user may be permitted to express an opinion on an existingobservation by voting on an existing ticket. In another embodiment, theuser may be permitted to submit an answer or opinion to the observation.The answer may be in the form of a yes/no response, or the user may bepermitted to submit an alternative answer. Here, the user is permittedto provide an additional statement that allows the user to qualify theirresponse.

In another example, the user is permitted to provide an additionalstatement which allows the user to provide an alternative response thatmay be viewed and selected by other users. Each of these possibleresponses may be viewed by other users in the ecosystem (e.g., as amultiple choice selection), from which they may choose to provide (ormay not) a different response.

The user may also be “charged” a currency for voting on a ticket. Forinstance, the user may be provided a particular number of points orother credit, and decremented each time the user votes on a ticket. Theuser's credit may be increased in response to a positive behaviorexhibited by the user in the ecosystem (e.g., the user creates tickets,provides early votes, becomes an expert in a particular field, etc.). Inthis manner, the system rewards positive behavior and encouragesparticipation in the ecosystem.

In one embodiment, when a user writes a ticket, the user classifies theticket. The classifications may include but are not limited toclassifying the ticket as a particular type of observation. There may bemore or less classification types, depending on the application, but aregenerally referred to herein as an observation. The tickets may also beclassified by the user and/or system. For instance, tags or otherclassification information may be associated with a ticket.

According to another embodiment, the ticket may also includeclassification information, either part of or separate from the ticket,the classification information indicating an organization of the ticketsuch that the ticket may be easily located. In one embodiment, it isappreciated that metadata in the form of “tags” or keywords may beassociated with information such as tickets, and tags may be used toclassify tickets. Because tickets have associated tags, tickets withsimilar or the same tags may be located more easily by a system or anassociated user. Further, actions may be performed in response to taginformation, such as alerting a user when a ticket having a particulartag is created, locating similar tickets using tag information, andother actions relating to the organization and control of tickets.

According to another embodiment, the system may present to the user aninterface that provide real-time feedback of classification informationas the user enters information associated with the ticket. For instance,a list of related tags may be presented to the user, and while the userenters description information of the ticket, the list of the mostrelevant tags may be changed in response to the entry of the user. Inthis way, the feedback permits users to create better tickets (by seeinghow the system would classify the ticket) and also permits the user toeasily locate similar tickets (e.g., by selecting tag informationpresented in real-time to the user in the interface).

According to one embodiment, an observation may be classified as a“Case” observation. Using such an observation, it may be useful topermit users to submit observations by users in a position to view aparticular event or condition. Generally, any user regardless of rank orstature may be suitable for making such an observation.

In another example, an observation may be classified as a “Consult”observation. In such an observation, it may be useful for a user tosubmit an observation, upon which other users can provide their opinionsor consultation on the observation. Generally, observations made byusers having a higher rank, voting history, or other status may bevalued by the system more than observations made by lower-ranked users.There may be other observation types and combination types thereof bywhich a particular observation may be classified.

In one embodiment, the online system may assign each ticket a “value.”Depending on the subject matter of the observation, the ticket may beassigned an initial value, which may be adjusted depending on the marketvalue of the ticket (e.g., the value of the ticket as determined by abid process involving interested information consumers) and/or theopinions (e.g., in the form of votes) set forth by other users relatingto the ticket.

The values may be assigned in real-time, when the ticket is created,however, the initial value can be revisited with the value on any giventicket increased or decreased as needed to promote the health of theecosystem. Health of the ecosystem may be monitored, for example, bymeasuring a number of votes received in a particular area, ticket, orissue. Once submitted, any other users can vote on a ticket or submit analternative answer with a ticket as well as forward the ticket to anyother users inside or outside the ecosystem.

The ecosystem may have a number of different types of consumers andproviders of information. Users that provide observations may or may notbe charged a fee for accessing the ecosystem, but in one embodiment ofthe ecosystem, information consumers are charged for their use andaccess to the observations and opinions provided by and ability of thesystem to established communication between others. In one examplesystem, consumers may be charged a subscription fee to observe overallactivity within the ecosystem. Such fees may be used, for example, tomaintain the ecosystem. Further, other fees may be charged to consumersfor cultivating tickets submitted by others. In such a system, forexample, customers may observe a ticket that the consumer wishes to drawattention to, or cultivate. Once the consumer becomes the owner of theticket (e.g., through a bid process or other process), the results ofthe ticket may be the exclusive property of that consumer. In anotherexample system, the results may not be shown to the public. In yetanother example, the results of the ticket may be the exclusive propertyof the consumer for a fixed period of time (e.g., 60 days) after which,the results are published to the ecosystem.

In such an ecosystem, it is appreciated that there may be trade-offbetween consensus and early warning, but according to one embodiment,such a model according to various embodiments may perform more quicklyand accurately than conventional survey models. In one such system, acustomer/information consumer may be permitted to set predefined“triggers” that alert the consumer if/when a user (e.g., a physician)makes an observation of interest. The consumer may then be able toidentify to the ecosystem how many users would need to vote on thatobservation for the observation results to be valuable to them. Thesystem may determine the current voting rates for the desired populationof users, the amount of incentives (e.g., money) that needs to beapplied, and when the consumer agrees, that consumer may be grantedexclusive access to the result information. Optionally, users that voteon the observation may be made available to the consumer for directcontact, permitting the consumer to more quickly and effectively reach atargeted group that has the necessary insight and/or experience in agiven area.

Example Process

FIG. 2 is a flowchart showing an example process 200 for interactingwith an ecosystem according to one embodiment of the present invention.In one example, the ecosystem may include one or more computers and/orcommunication systems used to communicate information between users. Auser may have an initial observation, insight or idea (e.g., at block210). At block 220, the user logs onto the system and uses an interfaceof the system (e.g., a web-based search engine or similar interface) tosearch and verify whether the observation, insight or idea does notalready exist. In one embodiment, the user may be required to join theecosystem (e.g., have a uniquely-identifiable identity such as ausername/password) in order to create tickets and/or vote.

The user may be permitted to create a ticket according to the initialobservation, and submit the ticket to the system. The system (and/or theuser) may search existing tickets to determine whether there is a ticketon a related subject of the idea, observation or insight at block 230.For instance, a keyword and/or tag search may be used to verify if aticket already exists on the user's insight, observation, question, ideaor thought. Such a search may be performed manually by the user, butadditional searching may be performed by the ecosystem itself (e.g., bysearching tag data stored in association with other tickets previouslycreated in the ecosystem).

If a similar ticket is found, then the user may be permitted to vote onthe existing ticket (e.g., by agreeing or disagreeing) with the existingticket at block 240, or by proposing an alternative response. The usermay optionally be permitted to perform other actions with respect to theticket, such as, for example, commenting on the observation by authoringa statement in a blog, comment area, or other location, sending theticket to other users, etc.

If no similar ticket was found and/or identified, then the user may bepresented the opportunity to create a new ticket at block 250. Thus, ifthe user and/or system did not identify any similar (or adequate)tickets, they could submit their own. A process of authoring a ticketmay involve the user submitting one or more pieces of information,including, but not limited to, a title for the ticket, a description ofthe observation, and any proposed classification(s) of the ticket (e.g.,through the use of tags), embedding images associated with theobservation (e.g., medical test results, pictures, etc.).

In one embodiment, the ecosystem may provide incentive to the users tomake the ticket specific enough so that others with the same observationwould identify with it, but not so general that the ticket wouldgenerate inconclusive insights. Once submitted, a ticket may be madeavailable for all users to vote on. The ticket author and those usersthat subsequently vote on the ticket now have a vested interest inpromoting that consensus.

Once a ticket is submitted or a vote made, users may be presentedreal-time feedback regarding the status of the ticket, and any statusregarding any payments to be made for submitting and/or voting ontickets. In one implementation, users may be compensated based theirability to predict consensus. In one example, the payout that a userreceives may be determined as a function of how many people vote inagreement after them, modified by the weight of the ticket, the user'sreputation, and a variable that describes the quality of the consensus.

FIG. 3 is a flowchart showing an example process 300 for interactingwith an ecosystem according to one embodiment of the present invention.Once a ticket has been posted on the online ecosystem, the ticket can beviewed and voted upon by users, can be forwarded by a user to theircolleagues, friends, peers, etc. via many sources of communication toencourage them to vote on the posted ticket at block 310. For example,tickets may be sent to other users via electronic mail, wireless paging,telephone, or any other method of communication.

As a product of maintaining the ecosystem, meaningful observations aregenerated, along with financial income for the ecosystem participants.In one embodiment, users are encouraged and rewarded for their votes andoriginal ideas at block 320. For instance, the amount that a user may berewarded may be influenced by the accuracy and speed in which they voteand predict outcomes. In addition, the system has the ability torecognize the trends as opinions and votes are posted by users, andprovide such information and trends to information consumers. Similarly,at block 330, the system may generate financial income for theparticipants as providers and consumers in the ecosystem.

FIG. 4 is an example use case showing an example process 400 forconducting an online system according to one embodiment of the presentinvention. A user (e.g., a physician) makes an initial observation(block 401). The user accesses the ecosystem and searches a ticketdatabase (block 402) to determine if there is a related ticket (andobservation) generated from another user.

If a ticket already exists, the user may find and vote on an existingticket (block 403). If not, the user is permitted to author a new ticket(block 404) and submit the same to the ecosystem. Additionally, the usermay encourage others to review and vote on the ticket (block 405),especially those users that have previously voted on similar tickets,are experts in a related field, or those identified with ability toaccurately predict events.

The ecosystem, after receiving user votes on the created ticket, maygenerate signals regarding the observation (block 406) that indicatesthe quality of the observation to others (e.g., information consumers).Also as discussed, users creating the ticket may receive financialrewards (e.g., compensation or income) depending on the quality of theobservation and need of the observation in the marketplace.

FIG. 5 is an example use case showing an example process 500 forconducting an online system according to another embodiment of thepresent invention. In the example, a client or other informationconsumer interested in particular observation information may be capableof setting (e.g., within an interface of a computer system) a triggerthat, when activated, causes the client to be notified when a tickethaving a particular parameter value is submitted (block 501). Forinstance, an equity trader may want to set a monitor for a particulardrug name of interest, a particular company name, or other parameter. Atblock 502, a physician or other user has an insight and submits a ticketto the ecosystem. In the example shown, the ticket may include someparameter (e.g., a keyword) that activates the trigger, and the clientis notified (e.g., at block 503). In one example, keywords of the ticketare used to create tags associated with the ticket, and triggers definedon these tags are activated when a ticket is created or otherwiseclassified using such tags.

At block 504, the ticket is opened for bidding to one or moreinformation consumers, who will bid to determine exclusive access to theresult of the voting process. After a winning bidder is determined, theticket is submitted to the ecosystem where other users vote on theticket (block 505). In parallel, physicians or other users may benotified that the ticket has been cultivated (block 506), wherecompensation is determined. When the ticket is cultivated andcompensation (e.g., a price) is determined for the winner's access tothe ticket, access to the result information is provided to the winningbidder (block 507).

After the ticket is cultivated, users may be permitted to vote on theticket as described above. Also, the client determined to be the winningbidder may be notified of any result or consensus determinationassociated with the ticket, or any updates that may occur afterconsensus is reached (block 508).

FIG. 6 is an example use case showing an example process 600 forconducting an online system according to another embodiment of thepresent invention. According to one embodiment, an information consumermay be capable of initiating collaboration in an area of interest. Forinstance, an information consumer (or client) may have a theory or otheridea for which they need feedback from the user community or otherwiseneeds feedback from a population of users. In one embodiment, theinformation consumer can target a particular user population (e.g., agroup of experts in a particular field) in order to receive theirfeedback on a particular topic. This may be particularly helpful as atool for a client to reach consensus on an issue in a timely manner froma group of experts or authorities in a particular area.

To this end, the client submits a ticket to the ecosystem (block 601).Because the idea is proposed by the information client, the specificclient may propose particular target goals, a timeline for developingconsensus on the issue, and may assign a dollar value to the ticket(block 602). The ticket is then submitted to the ecosystem (block 604)where the ticket can be reviewed and voted on by users. In this way, theclient may determine the parameters that define how the informationshould be delivered, how much the information is worth, etc.

In the case of an ecosystem that relates to medical issues, a physicianor other type of user permitted to participate in the ecosystem may viewand vote on the ticket. In one embodiment, a physician may set a triggerthat indicates when particular types of tickets are submitted to theecosystem. For instance, if a ticket relating to cardiac pacemakers issubmitted, a particular physician may be notified by the ecosystem. Auser may set a notification, for example, based on any type ofinformation associated with the ticket, including keywords,classification of the ticket (e.g., a tag value), or any otherinformation (block 603). Thus, based on a predefined notification, aphysician or other user may receive an indication of a ticket beingsubmitted to the ecosystem (block 605), increasing the probability thatrelevant users will vote on the ticket, and therefore, consensus will bereached earlier.

Because the client submitted and financed the ticket, that client maygain exclusive insight into the result of the consensus determination bythe ecosystem, and any related opinion data (block 606). Also, theclient may require further follow-up after consensus is reached, and mayhave additional options in this regard. For example, for a physicianthat votes on the ticket, a call may be set up to discuss related issues(block 607), continue research on the topic, or perform any other typeof effort.

As discussed, the ecosystem may be used to couple any type ofinformation providers and consumers for the purpose of exchangingobservations and information. For instance, professionals such aslawyers, consultants, investors, engineers, scientists, etc. may becapable of submitting observations to a group of information consumers.Information consumers may include any entity that is interested in theinformation, and more importantly, is willing to pay for theinformation. For instance, information consumers may include companies,firms, government entities, and individuals.

One embodiment of an ecosystem may be directed to the investmentcommunity which can offer significant rewards for information that isrelevant to investment. Increasingly, funds trade uponnear-instantaneous information about medical products that may affectcompany stock prices. An ecosystem that connects financial informationconsumers to physicians and other field observers can provide amechanism to identify relevant issues long before they are identifiedand released by traditional thought leaders (e.g., the FDA).

Pharmaceutical and medical device companies may also be importantrevenue sources. In the medical field, current reporting standardsdepend upon physician calls to report adverse events, and sometimes,without significant incentive on the part of companies to forward thereports. Companies may use the ecosystem to monitor events associatedwith their products so that they can gauge the adoption of new devices,detect adverse events, and solicit input from the online community.

Revenue sources can be divided into a plurality of categories, two ofwhich include surveillance and survey. Surveillance watches for trendsthat appear in new tickets and opinions. Although surveillance is, bydefinition, passive, the ecosystem can be manipulated by adjusting theticket value that is assigned to new and existing tickets. For example,the greater commercial value of tickets relating to particular subjectmatter may be adjusted so that these ticket types are valued overtickets relating to other types of matters. For instance, although it islikely that device and pharmaceutical tickets will likely have greatercommercial value, clinical insights with implications for public healthcan be weighted to attract more opinions. Thus, the behavior of userswithin the ecosystem may be adjusted using incentives.

Potential surveillance trends that may be monitored may include, forexample, the total number of opinions, the rate at which the number ofopinions increase, and the ratio of opinions (Yes vs. No, Agree vs.Disagree or some other opinion/observation), the composition of opinionmakers (average rank/reputation of user), among others. Surveillance maybe based on a subscription model and can be segmented (for sale todifferent markets) on the basis of a pattern, subject matter (including,for example, keyword search and subject headings), and patternrecognition, tag information, etc.

In one embodiment, a ticket may be created that consults a group ofusers. In particular, the ticket may be based upon intentionallyintroducing and/or promoting tickets to targeted groups of users. Forinstance, a customer who is looking to gather information on any giventopic can construct their own ticket (e.g., discussed above with respectto FIG. 6). Assigning of ticket value and promotion mechanism to gatherthis information may be conducted in real-time. Furthermore, the surveycan be targeted at specific user types. Responses can be categorized byuser profile, and weighted based on past performance.

Further, users may be “profiled” so that the ecosystem and its users maybe distinguished from one another for the purpose of evaluating theiropinions. This “profiling” allows for intermediation by the ecosystembetween the users and various clients. In one embodiment, the ecosystemmay be adapted to recognize and identify which users are the innovators,the thought leaders, and/or the best predictors generally or inparticular areas of expertise. This information is certainly oftremendous value to advertisers, manufacturers, etc., as thisidentification may be exploited (e.g., by advancing a particular ticketto a subset of users that are the best predictors to reach consensusearlier).

In one embodiment, the system may include the ability to track users anddistinguish among users based on their profile information. Forinstance, users may be distinguished based on their early recognition oftrends, ability (or inability) to post accurate predictions, votingaccuracy, and/or ability to influence others.

The ecosystem may also be adapted to offer any sort of combination ofindustry insight. For instance, the ecosystem may be able to targetusers by specialty, by predictive ability, ability to post accuratepredictions, ability to recognize trends early, ability to influenceothers, determining who the influencers are, among others.

Profiling also allows for the introduction of another variable intodetermining income, referred to herein as consensus “quality.” Theecosystem may be adapted to identify certain patterns in emergingconsensus. For instance, the system may identify users of a similartype. For instance, it is appreciated that a consensus about a ticketrelating to a specific medical specialty held by users in that samemedical specialty will have greater value. In other words, an opinionheld universally by a sub-segment of the user population, which is knownto be within that subset's area of expertise, indicates a far moreimportant or “pure” consensus.

Further, by collecting profile information, other types of trends may beobserved. For instance, the ecosystem may cross-reference emergingconsensus with a geographic and/or institutional distribution of theusers. Also, geographic information may be used to recognize collusionoutside of the system. Further, by observing voting patterns amongusers, collusion may be detected. For instance, patterns of voting thatuse the exact same population of users, or likewise the same sequence ofusers, can be a signal for off-line collusion.

Ecosystem Rules

The success of the ecosystem depends on the dynamic content created byits users. But the freedom necessary for this creates a problem: How canusers be encouraged to act in a manner that is productive to thecommunity without administrative oversight? According to one embodiment,users are provided incentives that match their personalities andinterests that will encourage them to share their knowledge with theecosystem. Further, it is appreciated that users should be discouragedfrom “gaming” the system to their benefit. For example, if a physicianwill gain a reward for creating a new ticket, what will prevent themfrom creating fifty meaningless ones?

Further, if there is a financial reward for submitting a correct vote,it is appreciated that there may be a mechanism that prohibits a user(e.g., a physician) from voting on every issue (i.e., guessing).Similarly, the ecosystem may be modulated to provide the types ofinformation that might be of interest to customers at a particular pointin time. According to one aspect of the present invention, the ecosystememploys a set of rules that provide incentives for certain actions andprovide disincentives for other actions.

For the ecosystem to remain viable, the system may include a mechanismto achieve certain things, for example:

-   -   Maintain a high throughput of fresh tickets.    -   Maintain sufficient volume of votes so that opinions are        rendered and “signals” can be detected.    -   Create incentive and disincentive that keeps users' interests        aligned with the overall goals of the ecosystem, preventing        gaming of the system.

According to one embodiment, one method for balancing the interests ofthe users with that of the ecosystem is a basic set of rules. In oneembodiment, these rules should to be sufficiently transparent so thatusers can understand the rules that are dictating their compensation,but retain a degree of opacity so that the system operator canmanipulate them to achieve commercial success. According to oneembodiment, four basic laws may be used to govern an online ecosystem:

Rank: It may be beneficial to disincentivize random voting and/or randomticket creation. This rule not only prevents users from blanketing theecosystem with as many votes as possible (in the hopes that one of thosetickets will reflect a large financial reward), but the rule also forcesusers to write tickets and/or vote on those topics for which they thinkthey might have a unique insight or “edge.”

According to one embodiment, a user's rank is calculated dynamically andis applied to a ticket at the time of writing or voting, and remainsconstant for the income related to that ticket. Therefore, at any givenmoment, a user's reputation (as represented by a user's rank), is basedon how accurately they have predicted the future consensus of theecosystem on any given ticket. Stated differently, rank is a reflectionhow often those who rendered an opinion after another user who renderedan opinion, agreed with the voter.

According to one embodiment, rank may be determined using the followingequation:

$\begin{matrix}{{Rank} = \frac{\left\lbrack {\left( {\#\mspace{14mu}{of}\mspace{14mu}{opinions}\mspace{14mu}{voted}\mspace{14mu}{in}{\mspace{11mu}\;}{agreement}{\;\mspace{11mu}}{after}\mspace{14mu}{you}} \right) - \left( {\#{\mspace{11mu}\;}{of}\mspace{14mu}{opinions}\mspace{14mu}{voted}\mspace{14mu}{in}\mspace{14mu}{disagreement}\mspace{14mu}{after}\mspace{14mu}{you}} \right)} \right\rbrack}{\left\lbrack {\#\mspace{14mu}{of}\mspace{14mu}{outstanding}\mspace{14mu}{tickets}\mspace{14mu}{or}\mspace{14mu}{opinions}} \right\rbrack}} & {{Equation}\mspace{14mu} I}\end{matrix}$

Income: Income for a ticket should be directly proportional to a user'srank, (i.e., the highest rank will result in the highest income).According to one embodiment, user rank may be combined with otherfactors to modify income on a ticket, such as, for example, thefollowing factors:

-   -   Ticket Weight—The ecosystem may include a mechanism for        determining which issues are valuable and which are not. For        example, a potentially fatal adverse effect of a major        prescription drug should be weighted much more highly than an        observation about a minor allergy. In one embodiment, ticket        weight may be equated with a value of the ticket (e.g., a dollar        value as determined through a bid process).    -   Consensus Quality—The ecosystem may be configured to reward        consensus differently. For instance, in one example, a 50/50        voting pattern presents a different quality of information than        90/10.    -   Temporal Weight—Earlier voters are taking greater risks, and        provide greater insight.

According to one embodiment, ticket income may be determined by thefollowing equation:

$\begin{matrix}{{Income} = \frac{{Rank} \times \left( {\#\mspace{14mu}{of}\mspace{14mu}{agreements}\mspace{14mu}{after}\mspace{14mu}{you}} \right) \times \left( {{ticket}\mspace{14mu}{weight}} \right) \times \left( {{consensus}\mspace{14mu}{quality}} \right)}{\left\lbrack {\#\mspace{14mu}{of}\mspace{14mu}{outstanding}\mspace{14mu}{tickets}} \right\rbrack}} & {{Equation}\mspace{14mu}{II}}\end{matrix}$

Ticket weight or value may have an associated value that is designatedby the system at the time of ticket creation, and reflects thecommercial value of the ticket to the client (information consumer). Oneimplementation using weight includes using the weight value as amultiplier that raises or lowers the value that the ticket generates.Alternatively, weight can be defined as a dollar value that is assignedto the ticket, and then is gradually drawn down as each successive voteris paid out.

Consensus quality may be measured, for example, by a variable that theclient describes to end users. A temporal weight may be defined withinthe income equation that rewards early voters and ticket writers, andthen exponentially decreases payout to later voters and ticket authors.

Balance: A rule may be used that brings into balance voting and ticketwriting. In some applications, user income for writing highly successfultickets may be considerable. As such, it is expected that users will beinclined to write as many tickets as possible. This creates twochallenges to the health of the ecosystem. First, the ecosystem'sability to render a consensus on any given ticket is based upon thenumber of votes that the ticket attracts. An ecosystem where arelatively small number of votes are spread out among a large number oftickets is not a healthy one, as it becomes difficult to determineconsensus on any particular ticket due to the spread out. Second,according to one embodiment, users should be incentivized to only writetickets on topics for which they believe that they have an insight.

These opposing forces can be brought into balance by tying the number oftickets that a user can write to the number of votes they have rendered.In one example, one ticket can be written by a user for every five (5)votes rendered by a user. In another example, the number of tickets canbe determined by a dynamically adjusted variable, based on the currenthealth of the ecosystem.

According to one embodiment, balance may be ensured using the followingequation:

$\begin{matrix}{{\#\mspace{14mu}{of}\mspace{14mu}{tickets}\mspace{14mu}{that}\mspace{14mu}{can}\mspace{14mu}{be}\mspace{14mu}{written}} = \frac{\#{\mspace{11mu}\;}{of}\mspace{14mu}{opinions}}{5}} & {{Equation}\mspace{14mu}{III}}\end{matrix}$which ties the number of tickets to be written to the number of votesthat can be cast. Alternatively, a “points” system may be used thatrelates the number of votes that could be cast by a particular user tothe number of opinions (or tickets) authored (e.g., by awarding pointswhen a user creates a ticket and decrementing points when a user voteson an opinion, or vice versa). Such a relation may encourage users toboth author opinions and vote on the opinions of others.

Self-Policing: Through its users, the ecosystem has the capability togenerate large amounts of information. However, this abundance ofinformation creates a problem in information management. The freedom tocreate new tickets can lead to insightful new observations, but it canalso lead to self-evident or clinically irrelevant ones.

Additionally, multiple users can make the same observation, wordeddifferently, causing confusion and decreasing the total votes made onthe observation. It would be impossible for the ecosystem itself tomanage the dynamic, user-created information. Therefore, the ecosystemhas created a mechanism for users to be incentivized to manage thesystem themselves. Before the generation of any new ticket in theecosystem, a user may be informed of basic guidelines. These guidelinesmay include the prohibition of self-evident or duplicate posts, or anyposts that might be explained by information existing in the publicdomain (e.g., journals, textbooks, databases, and other medicalreferences, etc.).

When any user in the ecosystem views a ticket, s/he can “report” it asnot conforming to these guidelines. This reporting will require someform of risk to that user in order to prevent frivolous reports. In hisreport, he will cite the ticket and explain his reasoning. Then, theecosystem will distribute his report to a random selection of thehighest-ranked users (e.g., the top 10 highest-ranked users) that theecosystem has determined have expertise on the ticket's subject. Theseusers will serve to arbitrate the report validity and will be rewardedfor doing so. These users will then vote if they agree with the originalauthor or the individual who cited the self-policing policy.

If the post is found to not meet the ecosystem's basic criteria or toviolate the self-policing policy it will be removed from the system, thecreating user will be penalized, and the reporting user will berewarded. If the post is valid, it will remain, and the reporting userwill be penalized. Through this system, all users who voted in agreementwith a removed ticket will lose the rank points they gained, and thoserank points will be awarded to the user that successfully cited the law.In this way, the ecosystem simultaneously disincentivizes users fromposting or voting on tickets that might be self-evident or unoriginal,while recruiting a population of users to self-police the system.Indeed, users will become increasingly inclined to examine tickets forviolations of the Self-Policing rule as the tickets grow in their numberof votes because the potential payout becomes higher and higher.

General Purpose Computer System

Various embodiments according to the present invention may beimplemented on one or more computer systems. These computer systems maybe, for example, general-purpose computers such as those based on IntelPENTIUM-type processor, Motorola PowerPC, AMD Athlon or Turion, SunUltraSPARC, Hewlett-Packard PA-RISC processors, or any other type ofprocessor. It should be appreciated that one or more of any typecomputer system may be used to facilitate an online ecosystem accordingto various embodiments of the invention. Further, the system may belocated on a single computer or may be distributed among a plurality ofcomputers attached by a communications network.

A general-purpose computer system according to one embodiment of theinvention is configured to perform any of the described functions,including but not limited to, creating, storing, and receiving votes ontickets by/from users and bidding on tickets by information consumers.It should be appreciated that the system may perform other functions,including paying users, receiving payments from information consumers,providing indications to users and consumers, etc., and the invention isnot limited to having any particular function or set of functions.

FIG. 7 shows a block diagram of a general purpose computer and networksystem 700 in which various aspects of the present invention may bepracticed. For example, various aspects of the invention may beimplemented as specialized software executing in one or more computersystems including general-purpose computer system 701 shown in FIG. 7.Computer system 701 may include a processor 704 connected to one or morememory devices 705, such as a disk drive, memory, or other device forstoring data. Memory 705 is typically used for storing programs and dataduring operation of the computer system 701. Components of computersystem 701 may be coupled by an interconnection mechanism such asnetwork 710, which may include one or more busses (e.g., betweencomponents that are integrated within a same machine) and/or a network(e.g., between components that reside on separate discrete machines).The interconnection mechanism enables communications (e.g., data,instructions) to be exchanged between system components of system 701.

Computer system 701 also includes one or more input/output (I/O) devices706, for example, a keyboard, mouse, trackball, microphone, touchscreen, a printing device, display screen, speaker, etc. In addition,computer system 701 may contain one or more interfaces (e.g., networkcommunication device 708) that connect computer system 701 to acommunication network (in addition or as an alternative to the network710.

The storage system 709, typically includes a computer readable andwriteable nonvolatile recording medium in which signals are stored thatdefine a program to be executed by the processor or information storedon or in the medium to be processed by the program. The medium may, forexample, be a disk or flash memory. Typically, in operation, theprocessor causes data to be read from the nonvolatile recording mediuminto another memory that allows for faster access to the information bythe processor than does the medium. This memory is typically a volatile,random access memory such as a dynamic random access memory (DRAM) orstatic memory (SRAM). The memory may be located in storage system 709,as shown, or in memory system 705. The processor 704 generallymanipulates the data within the memory 705, and then copies the data tothe medium associated with storage 709 after processing is completed. Avariety of mechanisms are known for managing data movement between themedium and integrated circuit memory element and the invention is notlimited thereto. The invention is not limited to a particular memorysystem or storage system.

The computer system may include specially-programmed, special-purposehardware, for example, an application-specific integrated circuit(ASIC). Aspects of the invention may be implemented in software,hardware or firmware, or any combination thereof. Further, such methods,acts, systems, system elements and components thereof may be implementedas part of the computer system described above or as an independentcomponent.

Although computer system 701 is shown by way of example as one type ofcomputer system upon which various aspects of the invention may bepracticed, it should be appreciated that aspects of the invention arenot limited to being implemented on the computer system as shown in FIG.7. Various aspects of the invention may be practiced on one or morecomputers having a different architectures or components that that shownin FIG. 7.

Computer system 701 may be a general-purpose computer system that isprogrammable using a high-level computer programming language. Computersystem 701 may be also implemented using specially programmed, specialpurpose hardware. In computer system 701, processor 704 is typically acommercially available processor such as the well-known Pentium classprocessor available from the Intel Corporation. Many other processorsare available. Such a processor usually executes an operating systemwhich may be, for example, the Windows-based operating systems (e.g.,Windows NT, Windows 2000 (Windows ME), Windows XP operating systems)available from the Microsoft Corporation, MAC OS System X operatingsystem available from Apple Computer, one or more of the Linux-basedoperating system distributions (e.g., the Enterprise Linux operatingsystem available from Red Hat Inc.), the Solaris operating systemavailable from Sun Microsystems, or UNIX operating systems availablefrom various sources. Many other operating systems may be used, and theinvention is not limited to any particular operating system.

The processor and operating system together define a computer platformfor which application programs in high-level programming languages arewritten. It should be understood that the invention is not limited to aparticular computer system platform, processor, operating system, ornetwork. Also, it should be apparent to those skilled in the art thatthe present invention is not limited to a specific programming languageor computer system. Further, it should be appreciated that otherappropriate programming languages and other appropriate computer systemscould also be used.

One or more portions of the computer system may be distributed acrossone or more computer systems coupled to a communications network. Thesecomputer systems also may be general-purpose computer systems. Forexample, various aspects of the invention may be distributed among oneor more computer systems (e.g., servers) configured to provide a serviceto one or more client computers, or to perform an overall task as partof a distributed system. For example, various aspects of the inventionmay be performed on a client-server or multi-tier system that includescomponents distributed among one or more server systems that performvarious functions according to various embodiments of the invention.These components may be executable, intermediate (e.g., IL) orinterpreted (e.g., Java) code which communicate over a communicationnetwork (e.g., the Internet) using a communication protocol (e.g.,TCP/IP).

It should be appreciated that the invention is not limited to executingon any particular system or group of systems. Also, it should beappreciated that the invention is not limited to any particulardistributed architecture, network, or communication protocol.

Various embodiments of the present invention may be programmed using anobject-oriented programming language, such as Java, C++, Ada, or C#(C-Sharp). Other object-oriented programming languages may also be used.Alternatively, functional, scripting, and/or logical programminglanguages may be used. Various aspects of the invention may beimplemented in a non-programmed environment (e.g., documents created inHTML, XML or other format that, when viewed in a window of a browserprogram, render aspects of a graphical-user interface (GUI) or performother functions). Various aspects of the invention may be implemented asprogrammed or non-programmed elements, or any combination thereof.

Various aspects of this system can be implemented by one or more systemswithin system 700. For instance, the system may be a distributed system(e.g., client server, multi-tier system). In one example, the systemincludes software processes executing on a system associated with a user(e.g., a client system). These systems may permit the user to create,submit, view, search, and vote on tickets within an online ecosystem.

Example System Architecture

FIG. 8 shows an architecture diagram of an example system according toone embodiment of the invention. It should be appreciated that FIG. 8 isused our illustration purposes only, and that other architectures may beused to facilitate one or more aspects of the present invention.

As shown in FIG. 8, a distributed system 800 may be used to conductfunctions of the ecosystem, including, but limited to, the creation oftickets, storing ticket information, determining and storing taginformation associated with tickets, performing voting actions,conducting client bidding, and storing user information. System 800 mayinclude one or more computer systems (e.g., systems 801, 808A-D) coupledby a communication network 804. Such computer systems may be, forexample, general-purpose computer systems as discussed above withreference to FIG. 7.

In one embodiment of the present invention, system 801 storesobservation information in the form of a ticket in one or more databases(e.g., database 802). Further, system 801 performs associated functionswith the observation information and its associated ticket.

System 801 may include a server process (e.g., process 805) thatresponds to requests from one or more client programs. Process 805 mayinclude, for example, an HTTP server or other server-based process(e.g., a database server process, XML server, peer-to-peer process) thatinterfaces to one or more client programs distributed among one or moreclient systems (e.g., systems 807A-807D).

According to one embodiment, client programs may be capable ofpermitting a user to create, submit, view, search, and vote on ticketswithin an online ecosystem. Such client programs may include, forexample, any type of operating system and/or application program capableof communicating with system 801 through network 804. In one particularinstance, a client may include a browser program (e.g., browser program809) that communicates with server process 805 using one or morecommunication protocols (e.g., HTTP over a TCP/IP-based network, XMLrequests using HTTP through an Ajax client process, distributed objects,etc.).

Although it is shown by way of example that a browser program may beused to access the ecosystem by users to perform ecosystem functions, itshould be appreciated that other program types may be used to interfacea user to server process 805. For instance, an application program thatis specially-developed to manage ticket data may be provided to permit auser to perform ecosystem functions according to various embodiments ofthe present invention. The client program may be, for example, a thinclient including an interface for managing ticket data. Alternatively,the client may be a scripted program, or any other type of programhaving the capability of transferring ticket data. According to oneembodiment, such client programs may, for example, be downloaded andinstalled over the network. Further, these client programs may be storedand distributed by system 801 in the form of one or more softwareprograms 803.

In one specific example, the client program may include an applicationprogram 810 that permits the user to create, submit, view, search, andvote on tickets within an online ecosystem. This program 810, in oneembodiment, may be integrated with browser program 809 executing onsystem 807D. For instance, the application program 810 may include oneor more controls that, when selected by the user, perform functions formanipulating ticket information. These controls may be written in avariety of programming languages, and the invention is not limited toany particular language. In one specific example, the control may be alink that, when selected, performs one or more programmed functions.Such functions may permit the user to create, submit, view, search, andvote on tickets within an online ecosystem.

Information stored in the database 802 may include, for example, ticketinformation including, but not limited to, a unique ticket identifier, adescription of the observation associated with the ticket, userinformation such as personal information, user names, ranking, votinghistory, classification information associated with the ticket (e.g.,tag information) and other information that can be used to facilitatethe online ecosystem.

This information may be collected from the user in an interface (e.g.,as presented by program 810) and stored in the database (e.g., database802). Additionally, client systems may store a local copy of a user'sticket information within a local database associated with the clientsystem (e.g., database 811 located on client system 807D). However, itshould be appreciated that the invention is not limited to storingticket and/or user information in any particular location. A clientsystem (e.g., clients 807A-807D) may include one or more interfacesthrough which ticket information may be presented to the user. In oneexample, ticket information and status may be presented in an interfaceof a browser program (e.g., browser program 809) executing on a clientcomputer system (e.g., system 807D).

Example Implementations

FIG. 9A is a block diagram showing an example creation of a ticketcreation and tagging process according to one embodiment of the presentinvention. At block 901, a user (e.g., a physician or other person thathas an observation or prediction) authors a ticket (e.g., on a clientsystem 807A-807D of FIG. 8) for submission to the ecosystem (e.g., inthe form of a distributed computer system 800). At block 902, the ticketis validated where it can be verified that the ticket is an originalconcept, is not similar to other tickets, etc. Further, the ticket maybe analyzed in order to provide one or more classifications (e.g., tags)for the observations that may be associated with the ticket. Such taginformation may be used to determine an initial value of the ticket,based on the related subject matter (e.g., an event related to apacemaker vs. a general health event).

In one embodiment, tags may initially be provided by the author of theticket. Further, in another example system, the system may generateand/or suggest other tags that could be associated with the ticket. Suchtags may be generated, for example, based on associations (or groups) ofrelated tags defined for similar tickets. Such tickets may include, forexample, tickets having similar tags and which feedback for such ticketshas been provided. Tags may also be suggested based on comparison withindustry databases, similar keywords, synonym databases, or any othersource of tag information.

In one example, the question or observation posed by the ticket may becompared to one or more databases (e.g., a keyword database 909 havingkeywords of other ticket entries) to determine whether the ticket is anoriginal ticket, and to create tags for the ticket. Further, theecosystem may have the ability to access other common databases such as,for example, disease and injury databases associated with theInternational Statistical Classification of Diseases and Related HealthProblems (commonly known by the abbreviation ICD) (e.g., ICD-9 database908), MEDLINE database (e.g., MeSH database 906), geographic andinstitution databases (block 907) or any other type of database resourceto determine if the observation is original and/or determine theclassification(s) of the ticket. Such classifications may occurautomatically, or may be posed to the author of the ticket as suggestedclassifications.

Once validated, the physician or other user may be presented a list oftags to which the ticket may be associated (block 903). The physicianmay then review the tags and add to them or modify the tags, asappropriate (block 904). Once the ticket is complete, the physician orother user submits the ticket to the ecosystem at block 905.

FIG. 9B is a block diagram showing example database elements accordingto one embodiment of the present invention that may be used in a ticketaccess and triggering process. For example, a user may search for and/orset triggers for particular tickets based on their tag information. Forinstance, a tagged ticket 911 in database 916 may be located in a userinterface (e.g., a browser program interface) by entering in one or moretags (or classifications). For instance, tags may be located based ondefined classifications in the database (e.g., medical terms in a MeSHdatabase 912, keywords 914 in a keyword database 909, etc.). Further,the ticket may be searched according to other information, such as, forexample, a location of or distance to the originator of the ticket(e.g., by accessing a geography database 913), a particular vote patternof the originating user 915 or any other type of information relating tothe ticket and/or its user. In this way, users can both classify ticketsand locate tickets of interest once submitted.

FIG. 10 is a flow chart showing an overall logic flow of ticket creationand lifetime in an online system according to one embodiment of thepresent invention. As discussed above, a user may make an observationand possibly submit the observation to an online ecosystem in the formof a ticket, or corroborate or refute a similar observation associatedwith an existing ticket. At block 1001, the user makes an observation.As discussed above, the user may search an online ticket database (block1002) to determine whether a similar ticket exists, or may browse theticket database (block 1003) by viewing, for example, a list of recenttickets authored in a ticket database, highest ranked tickets, or othercriteria or listing. In one embodiment, a user may locate tickets basedon classification information associated with a ticket. Suchclassification information may be in the form of one or more tagscreated by the ticket creator, the ecosystem, or other entity.

At block 1004, the user may author a new ticket if the observation isoriginal, or may alternatively find (block 1005) and vote on (block1006) an existing ticket. According to one aspect of the presentinvention, as discussed above, tickets created in the ecosystem may havetags or other classification information associated with the ticket(block 1007) so that the ticket may be located easily by users, theecosystem, or other entity. According to one embodiment, tickets thatare validated and classified may then be submitted to the ecosystem(block 1008) where they can be viewed and voted on by users. Also asdiscussed, the observations may be stored in the form of a ticket in adatabase (block 1009).

Users may set alerts or triggers (block 1010) that, when activated,notify the other user that a ticket having particular criteria has beensubmitted to the ecosystem. For instance, such triggers may be activatedbased on classification information (e.g., tag information) associatedwith a particular ticket. Also, once submitted, a ticket may beforwarded to colleagues (block 1011) or other types of users targeted bythe ticket. Ticket status may also be viewed by the originator in realtime, as votes are received along with any opinion data (block 1012).

Users continue to vote and submit opinions on the created ticket until asignal strength is reached (e.g., a consensus is formed and determinedby the ecosystem) at block 1013. Determination of signal strength (orconsensus) may be determined by any criteria, including, but not limitedto determining a minimum number of votes received on a particularticket, ratio of agreeing to disagreeing votes, or other criteria and/orcombination thereof. At block 1014, a final tally of the votes isdetermined, after which is determined a potential payout at block 1016.At block 1015, the user's profile (an originator, a voter) may beupdated to reflect the final status of the ticket, and any adjustment inthe user's rank or other profile information (e.g., ability to predictoutcomes).

After a closing of the vote, there may be continued activity relatingthe ticket including, but not limited to, a user being able to changetheir vote (block 1018), participation in an ongoing forum (block 1017),or other activity relating to the ticket.

FIG. 11 is a flow chart showing a thematic logic flow of ticket creationand lifetime in an application to the healthcare industry according toone embodiment of the present invention. As discussed above, auser/physician 1101 may make an observation 1103 that may relate to oneor more triggers set by a client 1102. The user may either author anoriginal ticket or vote on an existing ticket as discussed above.

In one example, client 1102 may be an investor that would like toobserve a particular company and/or its products. To this end, theclient 1102 sets a trigger 1104 that is stored in a database 1105 of theecosystem. If the user/physician makes an observation that activates thetrigger, client 1102 is notified. Similarly, client 1102 may makehis/her own observation and propose the same to the ecosystem for actionby one or more users.

In any case, both the client 1102 and user/physician 1101 may view astatus of the ticket. In one example, the user/physician may bepresented a “dashboard” view 1108 of the tickets created by theparticular user, and their statuses. Client 1102 may be presentedreal-time reports 1106 relating to the tickets owned by the client(e.g., through bidding or sponsorship) and may therefore view anyinsights related to consensus 1107.

FIG. 12 is a flow chart showing another example logic flow of ticketcreation and lifetime according to one embodiment of the presentinvention. At block 1201, a user has an observation and authors a newticket at bock 1202. At block 1203, a nominal signal strength of five(5) is assigned to the ticket, in that it will take five votes untilsignal strength is reached. Other methods for determining signalstrength may be used, and using the number of received votes in one ofmany possible methods. The ticket may also be assigned an initial valueof $500, although this value may be any value related to the worth ofthe observation.

At block 1204A, a first user (Dr. Dean, an intern (physicianin-training) having a rank value of 30.5) submits a first vote on theticket. Further users may submit votes on the ticket at blocks1204B-1204E until the ticket closes at block 1205. Such votes may alsohave a corresponding vote value at blocks 1208A-1208E, respectively.Notably, although the first user that votes has a lower rank (30.5) thana later user (50.5), the value of the first user's vote (1208A) isvalued higher than the vote of the fifth user (1208E), as earlier votesare valued more highly than later votes on the same ticket. Also, it isnoted that votes by users having a higher rank will be valued morehighly (e.g., a vote by Dr. Johnson (1208C) than the first voter Dr.Dean (1208A), due to the different rankings of the users. Also, votersthat incorrectly vote (Dr. Thomas at block 1204D) will yield a value of$0 for their vote (e.g., 1208D).

At block 1206, a report is generated after ticket closing, summarizingthe result of the voting process. Such a report may be made available tothe user that originated the ticket and a client that subscribes to theticket. After the voting concludes, and the ticket closes, one or moreactions may occur, such as conducting a forum to receive additionalcomments (block 1207), allowing users to change their votes, etc.

FIG. 13 is a flow chart showing another example logic flow of ticketcreation and lifetime according to another embodiment of the presentinvention which illustrates activity after the close of voting. Forexample, an observation “Rituximab is effective against CD20-positiveNHL.” is made (block 1302) by a physician. A ticket is authored by thephysician/user (block 1303) and is submitted to the ecosystem. A firstvote is received (block 1304) by an intern who votes “yes” to theobservation, after which a vote of “no” is received (block 1305) from amore experienced physician user. Afterwards, 200 users vote “yes” (block1306) and 50 users vote “no” (block 1307). During the voting process andprior to ticket close, 45 of the users that voted “no” change theirresponses to “yes” (block 1308), and at ticket close, there are 245votes in favor of the observation (block 1309) and 5 votes against theobservation (block 1310). Notably, due to the consensus forming in favorof the observation, the ranking and payout of the intern who voted “yes”increases, while the payout and the ranking of more-highly ranked userdecreases.

However, after ticket close, the result of a clinical trial is releasedto the public wherein it is shown that the observation is false (e.g.,Rituximab does not cure cancer). In response, 245 of the users who voted“yes” to ticket switch their answers to “no” (block 1312) while 5 usersmaintain their answers as “yes” (block 1313) until they change theirvotes to “no” after receiving the report (block 1315). Notably, in thisexample, the intern keeps the money earned through the voting processprior to ticket closing, however, his ranking an respect is lost due toactivity after ticket closing. Also the higher-ranked user does not makeany money due to the change in voting after ticket closing, but gains ahigher ranking and respect. Additional forum comments may be received atblock 1316.

User Interfaces

The ecosystem and its associated computer system(s) may present varioususer interfaces for submitting, organizing, and reporting variousinformation related to the ecosystem. FIG. 14 is a diagram showing anexample interface 1400 of an online system according to one embodimentof the present invention. The diagram shows a user screen that may bedisplayed, for example, in an interface of a browser program executingon a general purpose computer system as discussed above with referenceto FIGS. 7-8.

In one embodiment, interface 1400 may be personalized for a user thatlogs into the ecosystem. In one embodiment of the present invention, theuser logs into the system and may be permitted to view his/her name,title, date, time, and status. In addition, the user may be permitted toview all the tickets 1401 he/she has authored and voted on, along withhis/her rank 1403, position 1402 and earnings 1404 generated through useof the system. The user can also view various statistics, such as thenumber of users that are in online in real-time, the number of usersthat are registered with the ecosystem, current ranking 1407 and thenumber of earned tickets 1408 for that particular user. The earningnumber of tickets may be, for example, determined based on the number ofvotes placed for other tickets existing in the system.

Also, there may be one or more controls (e.g., links, buttons, inputfields, etc.) that permit a user to search and/or browse tickets in thedatabase. For instance, a selection of control 1405 may cause aninterface to be displayed that permits a user to locate tickets based onkeyword, tag information, or other criteria. A control 1406 may, whenselected by the user, display the most popular tickets in the systembased on activity, value, and or any other parameter, either alone or incombination. A further control 1409 may be provide that, when activated,displays to the user an interface in which the user may author andsubmit a ticket to the ecosystem.

Interface 1400 may have one or more associated interfaces (not shown) inwhich a user (e.g., either an information provider or an informationconsumer) may perform functions relating to the ecosystem. For instance,an information provider may search and submit tickets, createdescriptions of observations, set triggers, receive updates, forwardtickets to user groups, colleagues, etc. Similarly, informationconsumers may be presented one or more additional interfaces that permitthe information consumer to submit tickets for action by users, bid onoutcomes of existing tickets, view reports and opinion results, etc.

For example, after a user votes on a ticket, the user may be informedwhere they are in the voting order (first, second, third, etc.).However, the user may, according to one embodiment, may not be given anyinformation on the current “state” of the votes. In another embodiment,only the user originating the ticket may be permitted to view votingstatus. In parallel, the client that has successfully won the bid forthat ticket may be permitted to see votes materializing in real-time.According to one embodiment, results of the ticket may be kept hiddenfrom ecosystem users until the ticket closes. According to oneembodiment, it is appreciated that actual results should be hidden fromecosystem users, otherwise the results of the votes of the users willinfluence how subsequent users vote. This is a critical flaw inconventional “market style” systems, where the issue's value (e.g.,current market value) transmits information to the voter. When theticket reaches signal strength (either an absolute number of votesand/or a clear consensus), the “absolute results” of the ticket may be“published” (e.g., by displaying and/or sending the results to affectedusers) and users are paid out.

FIG. 15 shows another example interface 1500 according to one embodimentof the present invention. For example, an online ecosystem may supportthe creation of various types of tickets. For instance, one type ofticket may relate to an observation of a user (e.g., a “Case” tickettype, not shown), the user having a first-hand observation of an event.Other tickets may relate to an interpretation of observations (e.g., a“Consult” ticket type) upon which a survey of colleagues is desired.Tickets may have more that one type of classification, depending on theobservation.

A ticket may have one or more ticket types (e.g., ticket type 1501) withwhich a ticket may be classified. One or more actions may be performedby the system in relation to the particular ticket type. For instance,users may be compensated differently based on a particular ticket type(e.g., a user authoring a “Case” ticket may be compensated independentof rank of the user as being the first to observe a particular event).

Interface 1500 may include other information associated with the ticket,such as a title 1502 and a description 1503 of the ticket. Suchinformation may be used to form keywords, tags, or other classificationinformation associated with the ticket, to locate similar tickets,and/or to send alerts to other users that a ticket has been created in aparticular area or field. Interface 1500 may collect other informationassociated with a ticket, such as for example, specialty information1504 and any other keywords 1505 that are associated with a ticket. Suchinformation may also be used to locate tickets, trigger notifications toother users, or perform any other actions in the ecosystem.

A user may have an idea of possible responses that users may provide tothe observation, and may propose such responses in area 1506 ofinterface 1500. In one embodiment, other users may select the predefinedresponses (e.g., in a multiple choice listing) or they may propose analternative response. Such an alternative response may be presented toother users as an optional response.

Further, the author of the ticket may define the number of respondentsneeded (1507) on the ticket. The number of respondents may be used todetermine when consensus is reached, or may be used to define a minimumlevel of response after which consensus can be determined. Further, theauthor may define a deadline (1508) for responding to the ticket. Thatis, the ticket may have some time priority to it, and if the deadlinetime is exceeded, the ticket may be automatically closed.

Also, as discussed above, classification data (e.g., classification data1509) may be associated with a ticket in the form of one or more tags.Tags may, according to one embodiment, may take the form of keywords(1510) that are associated with tags created in the ecosystem. The usermay be presented, in the interface of the system, a listing of therelevant tags associated with a ticket as it is being created. In aspecific example, the presented list is changed dynamically in responseto information being entered by the user in the ticket creationinterface. For instance, as the user types in a description of theobservation in the “Body Text” section, tags are automatically generatedby the system in response to the entered information, and thus similartickets may be located more easily, as tag information (and thus linksto other similar tickets) is updated in real time. Interface 1500 mayalso use a quantity parameter (e.g., parameter 1511 indicating thequantity of tickets associated with a particular tag) or other relativeparameter to indicate how frequently a tag is used or reference othertickets. A user may select the keyword or tag in the interface to locateother similar tickets, thus minimizing the number of similar ticketsdefined on such a system.

This invention is not limited in its application to the details ofconstruction and the arrangement of components set forth in the previousdescription or illustrated in the drawings. The invention is capable ofother embodiments and of being practiced or of being carried out invarious ways. Also, the phraseology and terminology used herein is forthe purpose of description and should not be regarded as limiting. Theuse of “including,” “comprising,” “having,” “containing,” “involving,”and/or variations thereof in this document, is meant to encompass theitems listed thereafter and equivalents thereof as well as additionalitems. Such terms are to be construed as open-ended, that is, to meanincluding but not limited to.

Use of ordinal terms such as “first”, “second”, “third”, etc., in theclaims to modify a claim element does not by itself connote anypriority, precedence, or order of one claim element over another or thetemporal order in which acts of a method are performed, but are usedmerely as labels to distinguish one claim element having a certain namefrom another element having a same name (but for use of the ordinalterm) to distinguish the claim elements.

Having thus described several aspects of at least one embodiment of thisinvention, it is to be appreciated various alterations, modifications,and improvements will readily occur to those skilled in the art. Suchalterations, modifications, and improvements are intended to be part ofthis disclosure, and are intended to be within the spirit and scope ofthe invention. Accordingly, the foregoing description and drawings areby way of example only.

1. A computer implemented method for conducting an online informationbrokering service, the method comprising acts of: providing access to anonline system to registered users hosted on a distributed computersystem, the registered users comprising at least content generatingusers and information consumers, wherein the content generating usersdynamically create content within the online system, and wherein thedynamic content includes respective observations and respective opinionson the respective observations; permitting, in a user interface, acreation of at least one observation, wherein the at least oneobservation is generated by at least one registered user; displaying, ina respective user interface, the created at least one observation to atleast one other user, wherein the at least one other user is a contentgenerating user; accepting, from the respective user interface, anopinion of the at least one other user regarding the at least oneobservation submitted by the at least one user; collecting, for the atleast one observation, a plurality of respective opinions generated by aplurality of content generating users regarding the at least oneobservation; controlling, by the distributed computer system, access toat least one of the at least one observation generated by the at leastone registered user and any of the plurality of the collected respectiveopinions regarding the at least one observation, wherein the act ofcontrolling includes: permitting access by the plurality of contentgenerator users to at least one of the at least one observationgenerated by the at least one registered user and any of the pluralityof the collected respective opinions regarding the at least oneobservation; restricting access by a plurality of information consumingusers to at least one of the at least one observation generated by theat least one registered user and any of the plurality of the collectedrespective opinions regarding the at least one observation, wherein theact of restricting access includes permitting access by at least oneinformation consumer to at least one of the at least one observationgenerated by the at least one registered user and any of the collectedrespective opinions in response to receiving payment from the at leastone information consumer for access; and monitoring, automatically, bythe distributed computer system, at least one of the created at leastone observation generated by the at least one user and the plurality ofthe collected respective opinions regarding the at least oneobservation.
 2. The method according to claim 1, wherein the act ofmonitoring includes an act of executing a user generated monitorconfigured to identify information associated with at least one of thecreated at least one observation generated by the at least one user andthe accepted opinion information regarding the at least one observation.3. The method according to claim 2, wherein the act of monitoringincludes an act of notifying at least one of the registered users inresponse to identified information associated with at least one of thecreated at least one observation generated by the at least one user andthe accepted opinion information regarding the at least one observation.4. The method according to claim 1, wherein the act of monitoringincludes by an act of determining, by the computer system, that at leastone parameter associated with the user generated monitor has beensatisfied based on comparison of the information associated with atleast one of the created at least one observation generated by the atleast one user and the accepted opinion information regarding the atleast one observation and the at least one parameter.
 5. The methodaccording to claim 2, further comprising an act of permitting at leastone information consumer to define the monitor in a respective userinterface, wherein the monitor is configured to have at least oneparameter comparable with the information associated with at least oneof the created at least one observation and the accepted opinioninformation regarding the at least one observation.
 6. The methodaccording to claim 2, further comprising an act of permitting at leastone content generating user to define the monitor, in a respective userinterface, wherein the monitor is configured to have at least oneparameter comparable with the information associated with at least oneof the created at least one observation and the accepted opinioninformation regarding the at least one observation.
 7. The methodaccording to claim 2, wherein the monitor comprises an executableoperation associated with the at least one parameter, the executableoperation being activated by a comparison of the at least one parameterassociated and the information associated with at least one of the atleast one observation and the opinion of the at least one other userregarding the at least one observation.
 8. The method according to claim2, further comprising an act of executing by the computer system anaction based upon the creation of the at least one observation includingthe at least one parameter.
 9. The method according to claim 5, furthercomprising an act of notifying at least one registered user that the atleast one parameter associated with a monitor has been satisfied. 10.The method according to claim 6, wherein the at least one observationrelates to a product, and wherein the at least one user has establisheda monitor having at least one parameter associated with the product. 11.The method according to claim 1, further comprising an act of collectinga plurality of the at least one observation from a plurality ofregistered users and a plurality of respective opinions from a pluralityof content generating users regarding the at least one observation. 12.The method according to claim 11, wherein the act of monitoring includesan act of identifying, by the computer system, trends in the pluralityof the at least one observation and the plurality of respective opinionsfrom the plurality of registered users regarding the at least oneobservation.
 13. The method according to claim 12, wherein the act ofidentifying trends in the collected information includes an act ofdetecting by the computer system collusion between users in submissionof the plurality of the at least one observation and the plurality ofrespective opinions from the plurality of registered users regarding theat least one observation.
 14. The method according to claim 12, whereinthe act of identifying, by the computer system, trends in the collectedinformation includes an act of determining by the computer system aconsensus of opinion among the plurality of users regarding the at leastone observation of the ticket.
 15. The method according to claim 12,further comprising an act of determining a ranking of the at least oneof the plurality of registered users based on the trends in trends inthe plurality of the at least one observation and the plurality ofrespective opinions from the plurality of registered users regarding theat least one observation.
 16. The method according to claim 15, whereinthe act of determining a ranking includes at least one of an act ofincreasing the ranking in response to a determination that a submittedopinion of the at least one of the plurality of registered users agreedwith a determined consensus and an act of decreasing the ranking inresponse to a determination that a submitted opinion of the at least oneof the plurality of registered users disagreed with a determinedconsensus.
 17. The method according to claim 1, further comprising:permitting a content generating user to create a respective at least oneobservation and submit opinions on the at least one observation, andlimiting an information consumer to create a respective at least oneobservation and monitor the accepted opinion of the at least one otheruser regarding the at least one observation.
 18. The method according toclaim 12, further comprising determining an early consensus of opinionfor the plurality of the collected respective opinions, wherein the actof determining an early consensus of opinion includes determining aquality of consensus based on the identified trends within the pluralityof the at least one observation and the plurality of respective opinionsfrom the plurality of registered users regarding the at least oneobservation.
 19. A system, including at least one processor operativelyconnected to a memory, configured to conduct an online informationservice, the system comprising: at least one processor operativelyconnected to a memory, wherein the processor is configured to executesystem components from the memory; an access component configured toprovide access to an online information brokering service, wherein theonline information brokering service includes a plurality of registeredusers comprising at least content generating users and informationconsumers, wherein the content generating users dynamically createcontent within the online system, and wherein the dynamic contentincludes respective observations and respective opinions on therespective observations; a generation component configured to permit acreation of at least one observation generated by at least oneregistered user; a display component configured to display to at leastone other user from the content generating users, wherein the at leastone other user is a content generating user; a collection componentconfigured to accept an opinion of the at least one other user regardingthe at least one observation submitted by the at least one user, whereinthe collection component is further configured to collect, for the atleast one observation, a plurality of respective opinions generated by aplurality of content generating users regarding the at least oneobservation; a monitor component configured to automatically monitor atleast one of the created at least one observation generated by the atleast one user and the accepted opinion information regarding the atleast one observation; and a control component configured to controlaccess to at least one of the at least one observation generated by theat least one registered user and any of the plurality of the collectedrespective opinions regarding the at least one observation, wherein thecontrol component is further configured to: permit access by theplurality of content generator users to at least one of the at least oneobservation generated by the at least one registered user and any of theplurality of the collected respective opinions regarding the at leastone observation; restrict access by a plurality of information consumingusers to at least one of the at least one observation generated by theat least one registered user and any of the plurality of the collectedrespective opinions regarding the at least one observation; and permitaccess by at least one information consumer to at least one of the atleast one observation generated by the at least one registered user andany of the collected respective opinions in response to receivingpayment from the at least one information consumer for access.
 20. Thesystem according to claim 19, wherein the generation component isfurther configured to permit creation of a monitor by a registered user,wherein creation of the monitor includes defining information associatedwith at least one of the created at least one observation generated bythe at least one user and the accepted opinion information.
 21. Thesystem according to claim 20, and wherein the monitor component isfurther configured to notify at least one of the registered users inresponse to at least one of the created at least one observationgenerated by the at least one user and the accepted opinion informationcontaining the defined information.
 22. The system according to claim19, wherein the monitor component is further configured to identifytrends in collected information, wherein the collected informationincludes a plurality of observations and any accepted opinioninformation regarding the plurality of observations.
 23. The systemaccording to claim 19, further comprising a role component configured toestablish user roles corresponding to the content generating users andthe information consumers, wherein a content generating role isconfigured to permit a content generating user to create a respective atleast one observation and submit opinions on any created at least oneobservation, and wherein an information consumer role is configured topermit the information consumer to create a respective at least oneobservation and monitor the accepted opinion regarding any of the atleast one observation.